Job Closed
This listing is no longer active.
The largest platform for hiring top remote talent from Latin America.
Senior Data Engineer – Databricks, Azure
Location
Brazil
Posted
139 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Databricks, Azure
Workana
• Design, build, and optimize Databricks pipelines in an Azure environment • Develop reliable ETL/ELT workflows using PySpark / Spark SQL • Implement and maintain data ingestion from multiple sources (APIs, DBs, cloud storage, etc.) • Improve performance, scalability, and cost-efficiency of Databricks workloads • Work with stakeholders to translate business needs into technical solutions • Ensure best practices around data quality, monitoring, documentation, and maintainability • Collaborate with cross-functional teams (data engineering, analytics, product, etc.)
Job Requirements
- Proven experience as a Databricks Engineer (expert-level)
- Strong hands-on work in Azure Databricks
- Advanced Spark / PySpark and SQL
- Experience with Azure Data Lake / Blob Storage and Azure-native data workflows
- Solid understanding of data engineering fundamentals (batch processing, orchestration, data modeling basics)
- Comfortable working independently in fast-moving, delivery-focused projects
- English communication skills (written + verbal) for working with global teams
- Nice to Have
- Experience with Delta Lake and lakehouse patterns
- Familiarity with orchestration tools (e.g., ADF, Airflow, etc.)
- CI/CD exposure for data pipelines (Azure DevOps, Git-based workflows)
- Experience supporting analytics/reporting or downstream ML use cases
Benefits
- Fully remote contractor role (LATAM-friendly)
- Opportunity to work with a global healthcare leader
- High chance of extension after the initial contract
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Associate, Data Engineer – Databricks, AI, Technology Consulting
EYBuilding a #BetterWorkingWorld by providing trust through assurance and helping organizations grow, transform & operate.
• Ability to design data pipelines with scalability, high performance and resilience in-built • Ability to code complex requirements as part of large complex data platforms - develop, refine, and implement high quality delivery executions • Deliver project deployments on public clouds and highly secure environments • Integrate with data governance tools, ecosystem products across the cloud landscape • Ability to understand the business requirements and translate into high-level and low-level designs to successfully meets the business objectives. • Collaborate with stakeholders, presenting findings to a non-technical audience • Bring in best practices for coding and building modular data engineering code that can be reused • Stay current with technical and industry developments and standards to ensure effective and advanced applications of data analysis techniques and methodologies. Including AI integrations.
• Lead end-to-end Data Science projects using agile methodologies with a focus on delivering business value. • Perform exploratory analyses to identify patterns, trends and generate actionable insights to support decision-making. • Develop, evaluate and implement statistical, predictive and prescriptive models (supervised and unsupervised). • Act in a consultative manner to understand client pain points and needs throughout the project. • Present results, analyses and recommendations to technical and non-technical stakeholders with clarity and storytelling. • Collaborate actively with the team, sharing knowledge, best practices and new technical approaches. • Support internal requests and strategic initiatives when needed.
• Design, develop, and maintain robust, scalable data architectures in cloud or hybrid environments, aligned with clients' business needs. • Build and optimize data pipelines (batch and streaming), ensuring reliable ingestion, processing, and delivery of information. • Work with large volumes of data from multiple sources, focusing on solving business problems. • Model data for analytical, predictive, and prescriptive consumption, supporting data science teams and business stakeholders. • Ensure data security, governance, and quality, complying with internal policies and regulatory requirements such as LGPD (Brazilian Data Protection Law). • Identify opportunities for continuous improvement in data flows, promoting efficiency, cost reduction, and increased reliability. • Serve as a technical reference for the team and the client, supporting architectural decisions, providing technical mentorship, and promoting best practices.
• Set the technical direction for the data engineering team • Own the strategy, maintenance, and operations of our data platform • Lead a team of data engineers while staying hands-on with architecture decisions and technical leadership • Maintain and build feature stores and ML infrastructure to power our machine learning models



