Increase the power of your business
Senior Data Engineer – Databricks
Location
Brazil
Posted
17 hours ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Databricks
AGGRANDIZE
• Work on an SAP Commerce migration project, supporting the adaptation of the new SAP Commerce platform to the current data flows; • Perform maintenance and adjustments on existing pipelines, following directions and priorities defined by the client; • Contribute to the continuity of data migration and integration initiatives related to the project; • Support requests that fall outside the project's initial scope, ensuring the evolution and stability of data flows; • Participate in the analysis, correction, and enhancement of existing data processes; • Collaborate with the team on the maintenance and adaptation of solutions during the technological transition period.
Job Requirements
- Experience with Databricks
- Advanced knowledge of SQL
- Experience developing in Python and PySpark
- Knowledge of data modeling
- Experience with DevOps pipelines
- Knowledge of code versioning using Git
- Experience in data integration, transformation, or migration projects.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Diseñarás, desarrollarás y optimizarás pipelines y soluciones de datos escalables, fiables y mantenibles en entornos modernos de Data Warehouse, trabajando principalmente sobre Snowflake • Participarás en el diseño e implementación de modelos y soluciones de datos eficientes, aplicando buenas prácticas de modelado, transformación ELT, calidad, gobierno y rendimiento, con foco en la escalabilidad, mantenibilidad y evolución futura de las soluciones • Identificarás oportunidades de mejora continua en procesos, consultas, cargas, modelos, costes y flujos de integración, contribuyendo a la evolución de la plataforma de datos • Trabajarás de forma cercana con equipos de negocio y otras áreas técnicas para entender requisitos, traducirlos en soluciones robustas y asegurar la entrega de datos fiables, trazables y preparados para el consumo
• You design and own the architecture of our end-to-end data platform — from data integration and transformation to data delivery • You lead the development of robust data pipelines using Fivetran, Airbyte and Python, setting technical standards for the team • You drive outstanding data modeling in Databricks and apply advanced SQL, dbt and data-quality frameworks such as elementary • You define and establish standards for data quality and ensure reliable data marts that serve as the basis for business-critical decisions • You provide technical leadership and work closely with the Product Owner and the Business Insights team on complex data challenges • You are responsible for the ongoing development of our cloud infrastructure on AWS and advance Infrastructure as Code (IaC) using Terraform
• You design and own the architecture of our end-to-end data platform, including ingestion, transformation, and serving layers • You lead the development of robust data pipelines using Fivetran, Airbyte, and Python – setting engineering standards for the team • You drive data modeling excellence in Databricks using advanced SQL, dbt, and data quality frameworks like elementary • You define and enforce data quality standards, ensuring reliable data marts that power business-critical decisions • You act as technical lead, collaborating closely with the Product Owner and Business Insights team on complex data challenges • You own and evolve our cloud infrastructure on AWS, driving infrastructure-as-code with Terraform (IaC)
Principal Engineer, Data Science
NagarroNagarro (Frankfurt: NA9) is a leader in digital product engineering and drives technology-led business breakthroughs.
• Understanding the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements • Mapping decisions with requirements and be able to translate the same to developers • Identifying different solutions and being able to narrow down the best option that meets the client’s requirements • Defining guidelines and benchmarks for NFR considerations during project implementation • Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers • Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed • Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it • Understanding and relating technology integration scenarios and applying these learnings in projects • Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken • Carrying out POCs to make sure that suggested design/technologies meet the requirements.




