Donnes logo
Donnes

Conectando talentos para impulsionar a evolução das empresas

Lead Technology – Web Scraping, Data Platform

Data EngineerData EngineerFull TimeRemoteSeniorTeam 11-50Since 2021H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

23 days ago

Salary

0

Seniority

Senior

Job Description

Lead Technology – Web Scraping, Data Platform

Donnes

• Provide technical leadership for the company's technology function • Drive the evolution of the platform architecture, stability, and scalability • Lead technical decisions related to scraping, infrastructure, data, and back-end • Support the development of the technical team and the evolution of operations • Actively participate in development, troubleshooting, and critical stack decisions • Establish processes, best practices, and technical organization for the area • Work closely with the founders/partners on technology-related decisions and business growth.

Job Requirements

  • Strong experience with Python applied to large-scale web scraping
  • Experience with tools such as Scrapy, Playwright, Puppeteer, or similar
  • Experience in back-end development and building APIs
  • Knowledge of JavaScript and/or TypeScript
  • Experience with cloud computing on AWS and/or GCP
  • Experience with databases such as PostgreSQL, BigQuery, DynamoDB, and OpenSearch
  • Ability to operate strategically without losing technical depth
  • Experience providing technical leadership for people, projects, or operations.

Benefits

  • 100% remote
  • Potential stock options/equity
  • Compensation structured according to seniority and potential impact on the operation.

Related Categories

Related Job Pages

More Data Engineer Jobs

BD logo

Data Science Lead, Data Architect

BD

BD is a global medical technology company that is advancing the world of health. www.bd.com

Data Engineer23 days ago
Full TimeHybridTeam 10,001+Since 1897H1B Sponsor

Title: Data Science Lead, Data Architect Location: Franklin Lakes United States Job Description: We are the people who give possibilities purpose BD is one of the largest global medical technology companies in the world. Advancing the world of health is our Purpose, and it's no small feat. It takes the imagination and passion of all of us-from design and engineering to the manufacturing and marketing of our billions of MedTech products per year-to look at the impossible and find transformative solutions that turn dreams into possibilities. Job Description About the role: In this role you will be responsible for building and evolving BD's enterprise pricing intelligence architecture - the governed data and analytics ecosystem that powers price transparency, value-based pricing decisions, and commercial performance insights globally. You will design the underlying data models, orchestrate the pricing analytics stack, and enable advanced insights such as price waterfalls, price power indices, elasticity models, and AI-driven competitive intelligence. Key responsibilities include: Build the Enterprise Pricing Data Architecture - Design and maintain the governed data backbone supporting BD's pricing analytics ecosystem. - Define canonical data model for pricing (SKU/Customer/Region granularity), - Build harmonization of ERP, CRM, contract, and external market data Power Pricing Measurement & Insight Generation - Develop the analytics layer that translates data into actionable commercial intelligence. - Build scalable PBI models to support core pricing metrics, including price waterfall, Price Power Index and performance benchmarks, elasticity and willingness-to-pay modeling - Enable competitive intelligence and market price monitoring capabilities - Provide analytical insights on contract and rebate structures and leakage Enable Agentic AI & Advance Pricing Intelligence - Desing the pricing intelligence architecture to support the next generation AI-driven pricing insights and decision support including price recommendations and forecasting tools. - Build architecture that support Agentic AI workflows to generate contextual insights - Support integration of ML/LLM based reasoning to generate pricing projections, anomaly detection and scenario simulations. Drive Adoption & Enablement - Ensure the pricing intelligence platform becomes the core capability across the commercial organization - Support the implementation and evolution of pricing governance frameworks - Enable regional and BU pricing teams to effectively use the analytics platform - Strengthen pricing KPI and measurement standards in collaboration with Finance Required education and experience - Bachelor's Degree - At least 8 years experience across data engineering and data science in commercial/price analytics; Databricks expertise required - Experience building AI-enabled analytics platform, including familiarity with LLM orchestration frameworks and Agentic AI workflow applied in enterprise data environment - Advanced SQL proficiency with experience modeling billing/AR tables, FX normalization, and price waterfalls; understanding of GPO/admin fees/chargebacks. - Experience developing pricing analytics models such as willingness to pay (WTP), Price Power Index (PPI), price elasticity models governance. - Strong experience building Power BI sematic models and performance optimized dashboards - Ability to communicate complex analytical insights in clear, and effective language to influence cross-functional stakeholders - Excellent project and time management skills and ability to multitask amongst competing priorities - Action oriented individual who is highly proactive at solving problems and obtaining results Preferred qualifications: - Master's Degree At BD, we prioritize on-site collaboration because we believe it fosters creativity, innovation, and effective problem-solving, which are essential in the fast-paced healthcare industry. For most roles, we require a minimum of 4 days of in-office presence per week to maintain our culture of excellence and ensure smooth operations, while also recognizing the importance of flexibility and work-life balance. Remote or field-based positions will have different workplace arrangements which will be indicated in the job posting. For certain roles at BD, employment is contingent upon the Company's receipt of sufficient proof that you are fully vaccinated against COVID-19. In some locations, testing for COVID-19 may be available and/or required. Consistent with BD's Workplace Accommodations Policy, requests for accommodation will be considered pursuant to applicable law. At BD, we are committed to supporting our associates' well-being, development, and success through a performance-based culture. For this position, BD offers a competitive compensation package along with the following benefits specific to this role: - Annual Bonus - Potential Discretionary LTI Bonus - Potential reimbursement of vehicle use/mileage - Potential reimbursement of phone use Health and Well-being Benefits - Medical coverage - Health Savings Accounts - Flexible Spending Accounts - Dental coverage - Vision coverage - Hospital Care Insurance - Critical Illness Insurance - Accidental Injury Insurance - Life and AD&D insurance - Short-term disability coverage - Long-term disability insurance - Long-term care with life insurance Other Well-being Resources - Anxiety management program - Wellness incentives - Sleep improvement program - Diabetes management program - Virtual physical therapy - Emotional/mental health support programs - Weight management programs - Gastrointestinal health program - Substance use management program - Musculoskeletal surgery, cancer treatment, and bariatric surgery benefit Retirement and Financial Well-being - BD 401(k) Plan - BD Deferred Compensation and Restoration Plan - 529 College Savings Plan - Financial counseling - Baxter Credit Union (BCU) - Daily Pay - College financial aid and application guidance Life Balance Programs - Paid time off (PTO), including all required State leaves - Educational assistance/tuition reimbursement - MetLife Legal Plan - Group auto and home insurance - Pet insurance - Commuter benefits - Discounts on products and services - Academic Achievement Scholarship - Service Recognition Awards - Employer matching donation - Workplace accommodations Other Life Balance Programs - Adoption assistance - Backup day care and eldercare - Support for neurodivergent adults, children, and caregivers - Caregiving assistance for elderly and special needs individuals - Employee Assistance Program (EAP) - Paid Parental Leave - Support for fertility, birthing, postpartum, and age-related hormonal changes Leave Programs - Bereavement leaves - Military leave - Personal leave - Family and Medical Leave (FML) - Jury and Witness Duty Leave Why Join Us? To find purpose in the possibilities, we need people who can see the bigger picture, who understand the human story that underpins everything we do. We welcome people with the imagination and drive to help us reinvent the future of healthcare. At BD, you'll discover a culture in which you can learn, grow and thrive. We believe that when people connect in person, we learn faster, collaborate more deeply, and build a stronger culture. Join us and enjoy a culture where face-to-face collaboration supports your learning, your progress, and your success. To learn more about BD visit https://bd.com/careers. Becton, Dickinson, and Company is an Equal Opportunity Employer. We evaluate applicants without regard to race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, and other legally protected characteristics. Required Skills Optional Skills . Primary Work Location USA NJ - Franklin Lakes Additional Locations Work Shift At BD, we reward, support and develop our associates through our comprehensive Total Rewards program. We are committed to attracting and retaining high quality talent by providing reward and recognition opportunities that promote a performance-based culture, as well as a competitive package of compensation and benefits programs. You can learn more on our career site under "Our Commitment to You." Our salary or hourly rate ranges reward associates fairly and competitively. We regularly review these ranges and factors, such as location, contribute to the range displayed. Our pay is based on the role and the necessary skills and education to perform it successfully. The salary or hourly rate offered is determined by the role's specific requirements, including any applicable step rate pay system at the work location. Salary or hourly pay ranges are influenced by labor laws and Collective Bargaining Agreement (CBA) requirements applicable to the work location which may also affect the workplace arrangement of the role. Salary Range Information $152,600.00 - $244,200.00 USD Annual

New Jersey
$152.6K - $244.2K / year
SysMap Solutions logo

Senior Data Engineer

SysMap Solutions

#sejaSysMap #SysMap #soulSysMap

Data Engineer23 days ago
Full TimeRemoteTeam 1,001-5,000Since 1999

• Analyze business area requests, understanding processes and end-to-end data flows; • Participate in defining the technical solution and the architecture for data ingestion, transformation and consumption; • Design, evolve and maintain dimensional and analytical data models in the Data Warehouse and Data Lake; • Develop and maintain data pipelines in on-premise and cloud environments (ODI, AWS, Fabric); • Ensure data quality, reliability, integrity, performance, governance and traceability; • Work on integration between Teradata environments and cloud platforms; • Support BI and Analytics teams in making data available for analytical consumption; • Promote best practices, standardization, continuous improvement of the platform and provide technical support to less experienced teams.

Brazil
Vitrio logo

Junior/Mid-level Data Engineer

Vitrio

Quer aumentar seu resultado? Venha para Vitrio!

Data Engineer23 days ago
Full TimeRemoteTeam 51-200Since 2013H1B No Sponsor

• Support for Data Pipelines: Assist in the maintenance and development of pipelines that consolidate diverse sources (spreadsheets, analytics platforms, CRM systems, MMPs), helping to make data available as Data Marts for dashboards and stakeholders. • Data Quality Monitoring: Monitor existing data quality rules, helping to identify, report, and resolve inconsistencies to ensure the reliability of information. • Maintenance and Performance: Support the team in query optimization and day-to-day troubleshooting. • Documentation: Assist in creating and updating technical and business documentation for pipelines, models, and data rules. • Support: Help address requests from the marketing and data intelligence teams, learning to translate business requirements into data solutions.

Brazil
Extractta logo

Senior Data Engineer

Extractta

EXTRACTTA | Informações que geram Soluções

Data Engineer23 days ago
Full TimeRemoteTeam 201-500Since 2005H1B No Sponsor

• Design, develop, and support robust data infrastructure solutions with a focus on scalability, security, and efficiency. • Lead the implementation and maintenance of ecosystems such as Trino, AWS Glue, Redshift, Airflow, Kafka, and Spark on Kubernetes (K8s). • Collaborate with engineering, data science, and product teams to ensure seamless integration between systems. • Diagnose and resolve incidents related to performance, scalability, and reliability. • Apply and promote best practices in architecture, data governance, and monitoring.

Brazil