To a Future With More Cheers
Data Engineer
Location
Brazil
Posted
55 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
AB InBev
• Implement ETL/ELT solutions and data integration between multiple systems and data sources. • Design, implement, and maintain data pipelines to ingest, store, and process large volumes of data. • Collaborate with other teams to ensure data security and compliance. • Design, develop, and implement solutions to optimize the performance and scalability of data processing systems.
Job Requirements
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Systems Analysis and Development, or similar;
- Advanced English;
- Apply knowledge of data pipeline concepts and tools to implement data transformation, cleaning, and aggregation tasks.
- Use data pipeline frameworks and libraries to automate data processing tasks and optimize workflows.
- Follow best practices for developing data pipelines, including version control, testing, and thorough documentation.
- Apply programming skills in Python, PySpark, Scala, and SQL to effectively manipulate and transform data.
- Understand and utilize cloud computing platforms and services offered by providers such as AWS, Azure, and Google Cloud.
- Develop data pipelines using orchestration frameworks (e.g., Apache Airflow, Luigi, Mage, Databricks Workflows), integrating with PySpark and/or Scala as needed.
- Understand and apply software design principles to data engineering projects.
- Apply data modeling techniques to design efficient and scalable data models.
- Optimize PySpark and SQL query performance, considering data volume, query complexity, and system resources.
- Use data tools for ingestion, transformation, analysis, and visualization.
Benefits
- Performance-based bonus*
- Attendance bonus*
- Private pension plan
- Meal allowance
- Casual office and dress code
- Days off*
- Health, dental, and life insurance
- Medicines discounts
- WellHub partnership
- Childcare subsides
- Discounts on Ambev products*
- Clube Ben partnership
- Scholarship*
- School materials assurance
- Language and training platforms
- Transport allowance
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Staff Software Engineer, Data Engineering
AirbnbAirbnb is a community based on connection and belonging.
• Architect and productionize batch and real-time data systems to support various products and business needs. • Ensure the quality, performance, and stability of data systems through robust quality systems and monitoring practices. • Design and optimize data models for efficient storage and retrieval to meet critical product and business requirements. • Collaborate with cross-functional teams, including product managers, engineers, data scientists, and business partners, to align on data requirements and develop scalable systems. • Tune, productionize, and optimize data systems and machine learning models to enhance their effectiveness and efficiency. • Build and maintain strong relationships with partner engineering teams, including backend, client, data science, and ML teams, to ensure seamless integration and support. • Contribute to the development of long-term data strategies and roadmaps, and influence the technical direction of data engineering practices within the organization. • Mentor and coach team members, providing guidance and support to enhance their skills and performance.
Senior Software Engineer, Data Engineering
AirbnbAirbnb is a community based on connection and belonging.
• Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds. • Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy. • Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework • Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements. • Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity • Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues
Ingeniero de datos, contabilidad y finanzas
XpertGroupAcompañamos a nuestros clientes en su proceso de transformación digital a través de soluciones ágiles y de valor.
• Desarrollar e Implementar Modelos Analíticos con Python, Flask o Django, Shell Linux, PostgreSQL o MySQL, SOLID. • Desarrollar modelos analíticos que involucren librerías de Python Avanzado como Numpy, Pandas, Scikit-Learn, Tensorflow, NLTK. • Extraer, procesar y consumir la información desde los repositorios de datos. • Crear el roadmap de los modelos analíticos que serán ejecutados. • Participar en el desarrollo de proyectos de analítica. • Trabajar con Lenguaje Fuente abierta. Python (pandas y matplot is), Open Refine remediación de datos normalización, SQL, algoritmos del blockchain Quicksha, códigos de sha 256 o sha 512. • Impulsar y mantener una arquitectura que permita asegurar datos de alta calidad, para que sean consumibles por los diferentes equipos. • Utilizar los datos para determinar qué tareas se pueden automatizar o emplear en modelos predictivos y prescriptivos. • Identificar cómo mejorar la calidad, eficiencia y confiabilidad de los datos. • Apoyar al equipo de trabajo del cliente y de XpertGroup en los temas asociados a la ingeniería de datos y que no se encuentren descritos en las funciones anteriores. • Generar estimaciones de proyectos y contribuir en la planificación y gestión de recursos necesarios para la ejecución exitosa del mismo. • Cumplir con las demás funciones que le sean asignadas afines a la descripción del cargo y de acuerdo con el nivel, naturaleza y área de desempeño.
• Join a world-class team of engineers and data scientists • Work with clients ranging from leading startups to Fortune 500 companies • Produce high quality data tools and pipelines • Architect data ETL workflows and schemas • Apply critical thinking and problem-solving skills



