Driving Transformation in the automotive retail industry
Data Engineer II
Location
Brazil
Posted
69 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer II
MSX International
• Design, develop and maintain corporate data platforms that enable insights from customer data • Apply expertise in SQL and Python to execute projects and tasks with high quality, high accuracy and within established deadlines • Design, code, test, debug and document programs and scripts using agreed standards and tools, ensuring well-structured deliverables • Ensure data quality and implement tools and frameworks to automate the detection of data quality issues • Profile data sources and develop ETL processes, with a solid understanding of data modeling fundamentals, using SQL, Python and ETL/ELT support tools • Assist management in preparing estimates and proposals for clients • Plan effective solutions for data storage, security, sharing and publishing across the organization • Create and update documentation of process flows and business rules • Maintain existing pipelines and process large volumes of data as required
Job Requirements
- Bachelor’s degree in Computer Science, Statistics, Mathematics or a related field
- 3–5 years of experience in Data Engineering and/or Data Warehousing
- Experience designing and developing ETL/ELT data pipelines
- Proficiency writing advanced SQL queries
- Proficiency in Python and familiarity with common Python libraries
- Strong analytical skills with the ability to interpret and communicate the meaning of presented data
- Excellent mathematical, statistical and logical skills
- Excellent reasoning ability
- Enthusiastic, highly motivated profile with the ability to learn quickly
- Experience creating ETL workflows in Databricks
- Understanding of Apache Spark
- 3–5 years of experience in automotive operations or similar businesses (dynamic environment)
- Previous experience serving external clients
- Familiarity with MS SQL Server administration
- Experience with Git repositories
- Experience working with FTP and APIs
- Strong communication skills and practical knowledge of agile methodologies, including DevOps concepts
- Experience with data visualization tools (Tableau, Power BI, etc.)
Benefits
- Remote and/or office work
- Reasonable accommodations may be provided to enable people with disabilities to perform essential functions
- This vacancy is open to applications from people with disabilities or beneficiaries rehabilitated by INSS
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• To design, development, and enhancement of our AWS data environment.
Data Engineer
Metova, Inc.Helping companies transform their business through technology to meet the growing expectations of their customers.
• Participate in cross-functional meetings to define project objectives and scope. • Analyze and prioritize business requirements related to data. • Design and develop data extraction, transformation, and loading pipelines (ETL/ELT). • Develop applications for extracting data from various sources and formats (JSON, XML, PDF, etc.). • Write clean, efficient, and scalable code, adapting to new technologies as needed. • Implement data quality methodologies throughout ingestion and transformation processes. • Optimize services, queries, and processes to reduce operational costs and improve performance. • Validate the functionality, integrity, and security of data engineering processes.
• Design, develop, and maintain scalable and efficient data pipelines (ETL/ELT). • Build and optimize modern data architectures (Data Warehouse and Lakehouse). • Implement data models (primarily dimensional modeling using the Kimball approach). • Integrate multiple data sources ensuring quality, consistency, and availability. • Perform data profiling and anomaly detection. • Optimize SQL queries and performance across data platforms. • Collaborate on defining standards, best practices, and data architecture. • Implement CI/CD processes and DevOps practices applied to data pipelines. • Work under Agile methodologies (Scrum/Kanban) in collaboration with multidisciplinary teams.
Lead Data Engineer
HumanaLouisville, Kentucky-based Humana is a leading healthcare company that offers a variety of health, wellness, and insurance products and services designed to offer an integrated app
• Serve as a technical expert for Snowflake and Azure , leading hands ‑ on implementation across ingestion, transformation, orchestration, and platform optimization. • Develop and maintain API ‑ driven integrations using MuleSoft , enabling secure, scalable connectivity between cloud and on ‑ prem systems. • Drive the migration from on ‑ prem SQL Server environments to Snowflake , including re ‑ architecting pipelines, data models, and workflows for the cloud. • Implement engineering best practices, including CI/CD for data, infrastructure ‑ as ‑ code, version control, testing frameworks, and observability. • Independently troubleshoot complex data and platform issues , identifying root causes and designing effective long ‑ term solutions. • Collaborate with data architects, analysts, and business partners to translate requirements into robust, production ‑ ready solutions. • Mentor and support data engineers , providing technical guidance, code reviews, and thought leadership to elevate engineering standards. • Optimize data models, storage patterns, and compute usage to ensure cost ‑ efficient and high ‑ performance operations. • Partner with IT, security, and governance teams to ensure compliance, data quality, and secure handling of sensitive healthcare data. • Evaluate and introduce new tools, frameworks, and cloud capabilities that enhance our data platform and engineering productivity.




