#WeEnchantTogether
Data Engineering Specialist
Location
Brazil
Posted
34 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineering Specialist
Lojas Renner S.A.
• Lead and develop robust data pipelines using Databricks, Azure Data Factory, Python and PySpark to support large-scale data projects. • Design and implement scalable solutions for integrating and processing data from multiple sources, including transactional and operational data, ensuring high data quality and governance. • Work with SQL and Databricks to extract, transform and prepare data, as well as create complex transformations to meet analytical and operational needs. • Collaborate with business and data teams, helping translate technical requirements into effective solutions that directly impact logistics operations. • Develop and automate data ingestion, transformation and analysis processes using tools such as Azure Data Factory, APIs, Kafka and Oracle GoldenGate. • Lead the optimization of data pipelines and promote high-performance data engineering practices, with a focus on performance, scalability and proactive monitoring. • Ensure data quality and integrity through testing, validation and governance, collaborating with BI and data science teams. • Mentor junior data analysts and data engineers, fostering team growth and the adoption of data engineering best practices. • Foster innovation in the use of emerging technologies, such as machine learning and artificial intelligence, to apply predictive models and automation.
Job Requirements
- 4+ years of experience in Data Engineering with solid knowledge of SQL, Databricks, Python and PySpark.
- Experience designing and implementing scalable and efficient data pipelines using Azure Data Factory or other similar tools.
- Deep understanding of large-scale data processing, working with high volumes of data and distributed architectures.
- Experience with data integration and governance, ensuring data quality and reliability to support business decisions.
- Strong analytical and problem-solving skills to handle complex technical challenges.
- Ability to act as a technical leader within the team, guiding others in advanced technical solutions.
- Good communication and interpersonal skills, with the ability to work with different teams and stakeholders.
- Critical thinking and proactivity to identify and effectively resolve technical and operational issues.
- Preferred:
- Knowledge of MicroStrategy and Power BI to collaborate with BI and analytics teams.
- Experience with real-time data ingestion systems, such as Kafka, API integrations, etc.
- Experience in cloud environments, especially Azure.
- Familiarity with Machine Learning and AI models as applied to Data Engineering.
- LLMs, AI agents, Genies.
Benefits
- Transportation voucher and/or shuttle for positions at our distribution centers (DCs)*
- Meal voucher / food allowance
- Christmas gift basket voucher
- Home office allowance (for hybrid or remote employment contracts)*
- Multi-purpose purchase credit card
- Employee discount at our stores
- Health insurance
- Dr. Be (telemedicine, telepsychology, nutritional coaching and sports coaching)
- Wellhub (Gympass)
- Programs and campaigns developed to promote the health and wellbeing of our employees and their families.
- Balance methodology applied together with leadership and teams to strengthen communication and recognition, wellbeing, and work style/tools.
- Dental plan
- Univers - discounts at Raia and Drogasil pharmacies
- Pet health plan
- Running coaching
- Discounts on universities, schools, language courses and professional training
- Tickets to cinemas, parks and more.
- People with disabilities are welcome to apply for all our opportunities.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Lead Data Engineer, AWS Architect
DreamixBespoke software development company that provides custom end-to-end product development following the highest standards
• Lead teams of data engineers and analytics professionals, providing technical direction and mentorship across the project lifecycle • Architect and implement cloud-native data platforms on AWS, designing schemas and ingestion pipelines that handle structured data from diverse sources including Excel feeds, legacy databases, and third-party systems • Design, develop, and maintain ETL/ELT pipelines using AWS Glue and Step Functions, ensuring reliable data transformation, validation, and quality enforcement at every stage • Own the infrastructure-as-code practice using Terraform — provisioning, versioning, and managing all cloud resources with full reproducibility and environment consistency • Deliver end-to-end reporting solutions through Power BI, translating complex data models into intuitive dashboards that provide stakeholders with actionable, near-real-time insights • Translate complex technical concepts and architectural decisions to non-technical stakeholders clearly and persuasively, facilitating informed decision-making at all levels • Establish and enforce best practices around data quality, pipeline monitoring, documentation, and incident response • Participate in pre-sales and discovery efforts, leveraging technical expertise to support scoping, estimation, and business development initiatives
• Plan, manage, and execute releases across all environments - from development to production. • Identify technical and functional interdependencies between various tracks. • Coordinate with all development pods and stakeholders across programs. • Review application code, documentation, and perform pre/post deployment tasks. • Define release process for new data engineering applications. • Change management communication to all required stakeholders. • Execute release packages, step-by-step deployment guides, and command line instructions on production environment. • Support project timelines, clearly setting expectations, and realigning expectations internally as priorities change. • Develop a sound understanding of client’s needs: data conversion and migration requirements, environment management and build processes, deployment planning and execution, solution designs, systems integrations, technical architectures, and infrastructure architectures.
Data Architect
AliareSomos Aliare: a união de Siagri, Datacoper e Solution. O mais completo portfólio tech para o agro do Brasil.
• Lead the design and implementation of the Data Mesh architecture for the Aliare ecosystem; • Define integration strategies between legacy systems and the modern platform; • Establish federated governance standards across domains; • Design multi-cloud architecture (AWS, Azure, GCP); • Lead technical decisions regarding the data lake, APIs, streaming, and orchestration tools; • Mentor the technical team and establish best practices.
Role Description O(a) Engenheiro(a) de Dados deve ser capaz de criar, expandir e otimizar a arquitetura de pipelines de dados, bem como desenvolver e manter fluxos de dados de diversas áreas de nossos clientes. Este(a) profissional deve estar familiarizado(a) com conceitos e estratégias de DataOps, bem como execução de projetos gerenciados em modelo Ágil. O conhecimento de tecnologias de big data é imprescindível para esse cargo. É importante que se relacione bem com diferentes equipes - tecnologia e área de negócio principalmente - e que possa apontar oportunidades de melhoria na forma de estruturação dos dados para atingir o objetivo de análise do cliente. Responsibilities - Criar e realizar manutenção e melhoria de fluxos e dados (ETL e ELT) em casos de alta complexidade - Transformar dados - Realizar desenvolvimento, testagem, homologação, implantação, correção, entrega e automatização de testes em rotinas e processos complexos - Utilizar de ambientes Hadoop, Spark e estruturas Cloud (Azure, AWS e GCP) para construção e execução dos pipelines de dados - Participar de reuniões com equipe e clientes e das cerimônias propostas pela gestão de projetos ágeis - Interagir com áreas de negócio complexas para validação das entregas e realização de possíveis ajustes para o acompanhamento de Engenheiro(a) de Dados intermediários(as) - Identificar oportunidades de melhorias em processos, bem como desenhar e implementar as soluções propostas como: automação de processos manuais, otimização de data delivery, melhoria de arquitetura para aumento de desempenho e outras - Criar e melhorar continuamente a arquitetura de pipelines de dados - Combinar diversas bases de dados grandes e complexas para endereçar requisitos funcionais e não funcionais do negócio Qualifications - Domínio em Databricks - Experiência sólida com linguagem SQL e Python - Conhecimento do stack de dados Azure/AWS/GCP e técnicas de DataOps - Experiência com construção de fluxos de dados utilizando ferramentas de big data - Visão de foco no cliente e habilidade para comunicar ideias de forma clara e concisa, assim como em resolução de problemas Journey to Become a Fiver - Triagem de currículos - Bate-papo com equipe de Gestão Humana - Entrevista Técnica com lideranças do time - Entrevista Final com cliente Benefits - Vales Alimentação e Refeição (Swile) - Flexibilidade para crédito em Auxílio Home-Office (Swile) - Cobertura de até 100% em Plano de Saúde e Odontológico - Seguro de Vida em grupo - Trabalho remoto - Convênio Saúde Mental - psicoterapia online e presencial - Incentivo a certificações e cursos - Convênio para cursos de pós-graduação e MBA (Esalq/USP) - Parceria com escolas de idiomas - Parceria com academias e apps de bem-estar (Wellhub) - Palestras e rodas de conversa internas - Bônus por indicação - Happy hours - Mimos em datas comemorativas




