Job Closed

This listing is no longer active.

Leega logo
Leega

Inteligência, Inovação e Tecnologia.

Data Engineer – Azure, Databricks, Mid-level

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500Since 2010H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

139 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer – Azure, Databricks, Mid-level

Leega

• Perform data modeling by analyzing and structuring datasets to ensure proper relationships and adherence to industry best practices. • Handle special data by creating and managing equivalence tables, including specific cases such as “verticals”, aiming for greater standardization and efficiency. • Build pipelines that ensure full traceability from client file delivery through to loading into the Gold layer in Azure Databricks. • Identify opportunities for source-side automation to reduce reliance on manual files and increase efficiency. • Propose and implement efficient migration strategies, such as incremental loads, to avoid high costs from daily full loads. • Familiarity with code documentation. • Experience with agile methodologies. • Familiarity with developing process monitoring and alerts. • Ability to communicate technical solutions in a simple, pragmatic manner. • Proactive in supporting the team.

Job Requirements

  • Experience with Azure Databricks, PySpark, Workflows, and SQL Warehouse.
  • Experience with Python for data engineering (file reading, transformations, and data ingestion).
  • Knowledge of relational and non-relational databases.
  • Databricks certification.
  • Experience with low-code ETL tools.
  • Experience with PySpark.

Benefits

  • 🏥 Porto Seguro Health Insurance
  • 🦷 Porto Seguro Dental Insurance
  • 💰 Profit Sharing (PLR)
  • 👶 Childcare Assistance
  • 🍽️ Alelo Meal and Food Vouchers
  • 💻 Home Office Allowance
  • 📚 Partnerships with Educational Institutions
  • 🚀 Support for Certifications, including Cloud
  • 🎁 Livelo Points
  • 🏋️‍♂️ TotalPass
  • 🧘‍♂️ Mindself

Related Categories

Related Job Pages

More Data Engineer Jobs

Machinify logo

Senior Data Engineer – Analytics

Machinify

The future of payment integrity.

Data Engineer139 days ago
OtherRemoteTeam 1,001-5,000H1B Sponsor

• Design and implement robust, production-grade pipelines using Python, Spark SQL, and Airflow to process high-volume file-based datasets (CSV, Parquet, JSON). • Lead efforts to canonicalize raw healthcare data (837 claims, EHR, partner data, flat files) into internal models. • Own the full lifecycle of core pipelines — from file ingestion to validated, queryable datasets — ensuring high reliability and performance. • Onboard new customers by integrating their raw data into internal pipelines and canonical models; collaborate with SMEs, Account Managers, and Product to ensure successful implementation and troubleshooting. • Build resilient, idempotent transformation logic with data quality checks, validation layers, and observability. • Refactor and scale existing pipelines to meet growing data and business needs. • Tune Spark jobs and optimize distributed processing performance. • Implement schema enforcement and versioning aligned with internal data standards. • Collaborate deeply with Data Analysts, Data Scientists, Product Managers, Engineering, Platform, SMEs, and AMs to ensure pipelines meet evolving business needs. • Monitor pipeline health, participate in on-call rotations, and proactively debug and resolve production data flow issues. • Contribute to the evolution of our data platform — driving toward mature patterns in observability, testing, and automation. • Build and enhance streaming pipelines (Kafka, SQS, or similar) where needed to support near-real-time data needs. • Help develop and champion internal best practices around pipeline development and data modeling.

California
Job Closed
Netflix logo

Manager, Ads Data Engineering

Netflix

Described as the world's top internet television network, Netflix is a publicly-traded entertainment company offering video-on-demand and streaming media. As an

Data Engineer139 days ago

• Lead a team of strong engineers building high-scale, highly reliable data processing systems serving the Ads domain • Build a strong team vision and roadmap for the team • Partner with stakeholders to enable collaboration among teams • Provide direct, constructive feedback grounded in empathy • Monitor and proactively address productivity and efficiency • Hire and grow a diverse, high-performing team

United States
$360K - $920K / year
Job Closed
Netflix logo

Full Stack Software Engineer 5 – Data Architecture, Integrations

Netflix

Described as the world's top internet television network, Netflix is a publicly-traded entertainment company offering video-on-demand and streaming media. As an

Data Engineer139 days ago

• Drive the design, development, and governance of data integrations across HR systems • Set integration standards and collaborate with engineering partners • Build robust, reusable, well-governed data pipelines and APIs • Develop full-scale applications when needed • Serve as thought leader and trusted advisor for data integration and architecture

United States
$100K - $600K / year
Job Closed
Eton Technologies logo

Data Engineering Consultant

Eton Technologies

ERP | Cloud | Analytics | Integrations | IT Support

Data Engineer139 days ago
OtherRemoteTeam 51-200Since 2016H1B No Sponsor

• Lead and deliver modern data platforms and analytics initiatives for global clients. • Blend hands-on data engineering, solution architecture, and client advisory responsibilities. • Work closely with business and technical stakeholders to design scalable, secure, and high-performance data solutions.

United States