Job Closed
This listing is no longer active.
Inteligência Artificial para Acessibilidade Digital
Data Engineer Lead – Tech Lead, Data Engineering
Location
Brazil
Posted
178 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer Lead – Tech Lead, Data Engineering
Hand Talk
• Define the team’s technical priorities, translating the Head of Data Engineering’s business vision into actionable technical requirements; • Mentorship and Code Review: Raise the team’s technical standard through rigorous code reviews and continuous mentoring of data engineers; • Governance and Standards: Establish Data Quality standards, pipeline observability, and data lineage documentation; • Infrastructure Decisions: Lead the Infrastructure-as-Code strategy (Terraform), ensuring consistent development, staging, and production environments; • Data Culture: Promote a data-driven culture and platform adoption by eliminating manual processes and silos;
Job Requirements
- Technical Skills:
- Large-scale data architecture with a focus on high performance and low cost;
- Proficiency in Python and SQL;
- Proven experience leading technical data engineering teams;
- Proven experience managing, deploying, and maintaining data platforms (Data Warehouse, Data Lakes, and Data Lakehouses);
- Software engineering knowledge including API design, design patterns, and platform maintenance;
- Tech stack: solid/advanced knowledge of Apache Iceberg, AWS (EC2, Glue, Athena, DataZone, Lake Formation), Airflow, Terraform, DBT, Prometheus, and Grafana;
- Advanced English (written and spoken).
- Behavioral Skills:
- Ability to anticipate how a platform change or a new data source may impact the published data and platform architecture;
- Ability to guide the team in making technical decisions without relying on hierarchical authority;
- Ability to identify technical and behavioral improvement opportunities for team members and act in a humane, individualized way;
- Clear, objective communication;
- Autonomy and resilience;
- Ability to translate technical concepts for a diverse group of stakeholders.
- Differentiators:
- Experience with complex migrations from legacy data lakes or manual processes to a modern Lakehouse;
- Integrations with hybrid and multi-cloud environments;
- Experience with Data Governance;
- Experience driving platform adoption in large organizations.
Benefits
- CLT employment contract: Your security and full labor rights guaranteed from day one.
- Caju Benefits Card (BRL 1,160): Flexibility to use your balance as you prefer—meal, food, home office, culture, or mobility!
- Remote work — from wherever you are!
- SulAmérica health plan
- SulAmérica dental plan
- SulAmérica life insurance
- Online consultations with specialists via Conexa Saúde telemedicine
- Wellhub: support to help you perform at your best
- Extended year-end break: celebrate the holidays with more peace of mind
- Birthday day off: a special day of rest during your birthday month
- Extended parental leave: support and quality time for those growing their families
- Continuous professional development: access to top platforms like LinkedIn Learning, plus an annual allowance for courses and training
- University partnerships: support to go further through discounts and giveaways
- Libras training: learn Brazilian Sign Language to better support our community
- English language support: we encourage language learning through partnerships
- Work equipment shipped to you as part of your onboarding kit.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Build and maintain data extraction pipelines from various sources into BigQuery • Refactor and modernize existing extraction systems • Implement monitoring and alerting for pipeline health • Help design and implement our orchestration platform (tooling TBD as a team) • Build scheduling, dependency management, and failure recovery into our data workflows • Create visibility into pipeline status for the broader team and business • Maintain and optimize our BigQuery data warehouse • Support DBT model development and deployment workflows • Implement CI/CD for data infrastructure changes • Support SOC 2 compliance requirements for data systems • Implement security controls and access management in BigQuery • Document data flows and maintain data catalogs
Data Engineer – Medior
Refinery89Helping publishers and advertisers to drastically increase their results from ads #ForPublishersByPublishers
• Design, build, and maintain data pipelines supporting Refinery89’s core data platform • Contribute to the design and evolution of the company’s data architecture and tooling • Implement reliable ingestion, transformation, and storage processes for structured and semi-structured data • Ensure data reliability, consistency, and basic data quality controls across systems • Collaborate with engineers and internal stakeholders to support analytics and operational use cases • Maintain clear, consistent technical documentation for data systems and workflows
• Develop ETL jobs on AWS Glue (PySpark/Python) • Implement ingestion pipelines and configure Glue Crawlers • Collect and ingest data from multiple sources (internal APIs, SharePoint) • Monitor and troubleshoot pipelines • Integrate with Redshift for loading curated data • Core services: AWS Glue, Amazon S3, Redshift, AWS Data Lake.
• Design, develop, and maintain scalable ETL pipelines and data workflows. • Build, optimize, and maintain data processing solutions using Azure Databricks. • Support phased data migration from legacy databases and ETL tools. • Implement layered lakehouse data architectures in Databricks. • Develop data processing notebooks, workflows, and distributed data transformations using Python and PySpark. • Develop data validation, reconciliation, and testing processes. • Integrate Databricks data platforms with analytics and reporting tools. • Support data governance initiatives including metadata management. • Maintain source control and CI/CD pipelines for Databricks workflows. • Provide ongoing support for Databricks workflows and troubleshoot complex issues. • Provide guidance to junior data engineers and contribute to documentation and team enablement.
