At AFL, We Connect™.
Senior ETL Developer – Azure, MDM/Reltio
Location
South Carolina
Posted
4 days ago
Salary
0
Seniority
Senior
Job Description
Senior ETL Developer – Azure, MDM/Reltio
AFL
• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory and Microsoft Fabric Data Pipelines • Build scalable data ingestion frameworks for structured and semi-structured data (SQL, APIs, flat files, streaming sources) • Develop transformations using Synapse SQL, Spark (Synapse/Fabric), or Dataflows Gen2 • Optimize pipeline performance, reliability, and cost efficiency • Develop and manage solutions leveraging: Azure Synapse Analytics (dedicated & serverless pools) • Microsoft Fabric (Lakehouse, Warehouse, Data Engineering experiences) • Azure Data Lake Storage Gen2 • Implement medallion architecture (Bronze/Silver/Gold layers) where applicable • Collaborate with architects to design scalable data platform solutions • Design and implement MDM integration workflows with Reltio • Build and maintain pipelines to ingest, synchronize, and publish master data • Work with business and data governance teams on: Data quality rules • Matching and survivorship logic • Golden record management • Integrate Reltio with downstream analytics and operational systems • Implement data validation, cleansing, and lineage tracking • Ensure compliance with governance policies and standards • Support auditing, monitoring, and alerting for data pipelines • Work closely with data architects, analysts, and business stakeholders • Participate in Agile delivery (Scrum/Kanban) • Mentor junior developers • Contribute to coding standards and best practices • Participate in a rotating on-call support schedule for production data pipelines and platforms • Troubleshoot and resolve production issues, ensuring minimal disruption to business operations • Perform root cause analysis and implement long-term fixes for recurring issues
Job Requirements
- Bachelor’s degree or equivalent experience
- 5–8+ years of experience in ETL/data engineering
- Strong expertise in: Azure Data Factory (ADF) – pipelines, triggers, integration runtimes
- Azure Synapse Analytics – SQL, Spark, pipeline orchestration
- Microsoft Fabric (preferred or emerging experience)
- Solid experience with: SQL (advanced query tuning and development)
- Python and/or PySpark
- REST APIs and data integration patterns
- Hands-on experience with Reltio MDM including: Data model configuration
- Match & merge rules
- Data onboarding and outbound integrations
- Data Engineering Concepts
- ETL/ELT design patterns
- Data warehousing and dimensional modeling (Kimball, Data Vault familiarity a plus)
- Data lake architectures
- Performance tuning and scaling
- Experience with: Delta Lake / Lakehouse architecture
- CI/CD for data pipelines (Azure DevOps, Git integration)
- Infrastructure as Code (ARM, Bicep, Terraform)
- Data governance tools (Purview or similar)
Benefits
- Flexible time off policy
- 401K Company match (up to 4% - dollar for dollar)
- Professional development, training, and tuition reimbursement programs
- Excellent medical, dental, vision, and life insurance policy options
- Opportunities for career advancement with an industry leading company!
Related Guides
Related Categories
Related Job Pages
More Analytics Engineer Jobs
Senior Data Analytics Specialist – Audit and Compliance
Sharp HealthCareWe are San Diego's health care leader.
• Provides a critical role in meeting the Internal Audit and Compliance Integrity Services strategic initiative of maximizing the value of data analysis and visualization. • Combines an understanding of Sharp information systems and applications with the sophisticated use of data analysis and visualization technology to evaluate the effectiveness of controls, provide insights that contribute to the overall audit strategy, increase departmental productivity, and provide continuous auditing and monitoring of internal controls. • Collaborates with stakeholders in obtaining input on projects, developing and achieving consensus on the design and implementation of continuous auditing and monitoring projects. • Participates in audits, special projects, and other duties as assigned. • Designs and implements continuous auditing and monitoring programs to provide ongoing assurance over key business processes.
• Design and implement the end-to-end data transformation lifecycle using dbt Cloud and Databricks. • Build and evolve the diagnostic engine that detects Product Gaps, Operational Errors, and Technical Hotfixes. • Transform technical complexity into high-performance, self-describing Data Products. • Serve as the technical escalation point, define best practices for modeling, testing, and documentation. • Lead the transition toward a decentralized data model, developing self-serve standards and spearheading AI agent initiatives.
AV Safety Engineering Analytics Engineer (GPSSC)
General MotorsGeneral Motors (GM), founded in 1908 by William "Billy" Durant in Flint, Michigan, began with the Buick Motor Company and later acquired brands like Oldsmobile and Cadillac, evolvi
Description Work arrangement : Remote: This role is based remotely but if you live within a 50-mile radius of [Atlanta, Austin, Detroit, Warren, Milford or Mountain View], you are expected to report to that location three times per week, at minimum. The Safety Assurance for Effective Autonomous Driving Software (SAFE-ADS) department is part of GM's Global Product Safety, System, and Certification (GPSSC) organization. Our mission is to help GM deliver trustworthy automated-driving products. As the central authority for automated driving system (ADS) safety, SAFE-ADS brings together experts from across the company to develop and maintain a comprehensive safety case including safety performance indicators for GM's automated-driving technologies. GM's vision is zero crashes, zero emissions, and zero congestion-and autonomous vehicle safety is essential to achieving that vision. The Role The AV Safety Engineering Analytics team is seeking an AV Safety Analytics Engineer with capabilities at the intersection of automotive engineering, data science and cloud processing. The AV Safety Engineering Analytics team is the resource supporting teams and stakeholders from around the company bring a broad range of data and analytics capabilities to bear in AV safety related decision making. This team will maintain proficiency integrating continuously flowing data from vehicle systems, company databases, third-party services, federal agencies and state DOTs to inform system design and quantify driving performance. The team focuses on continuous up-time proactive analyses as well as supporting specific investigations. If you're passionate about the benefits of autonomous vehicle technology, committed to advancing safety through innovation, and love channeling big data into clear guidance, this role offers exciting opportunities to make a meaningful impact on the future of transportation safety in a dynamic and fun environment. As part of the AV Safety Engineering Analytics team, you will work closely with cross-functional partners and internal customers to prototype, define, and productionize performance metrics and sufficiency criteria. You will engage deeply with stakeholders to understand their challenges and needs, collaborate to develop solutions. What You'll Do - Develop data analytics infrastructure that supports safety assurance analytics addressing internal and external stakeholder needs across the phases of automated vehicle development and deployment, including both real-world and simulation data. - Develop interactive visualizations in support of enhancing transparency and reduction in barriers to source data interrogation. - Pilot and define metrics for monitoring of development operations and deployment, and establish sufficiency criteria for launch readiness. - Identify relevant data for supporting safety monitoring and the development of a reliable supply chain of continuously flowing data from a variety of sources (internal and external) to support safety assurance related activities. - Develop cloud-based continuous up-time analytics pipelines that manage data from a raw form, through analyses, and into browser based interactive visualizations and periodic reporting artifacts. - Select appropriate engineering- and physics-based signal processing, sampling, filtering, smoothing etc to prepare raw signals for analyses and/or storage in a down sampled form. - Integrate and transform data streams to construct physically meaningful representation of vehicle motion, driving context, and intermediate system performance, including reduction of time-series representations to features. - Apply engineering domain expertise to distinguish erroneous sensor data from real outliers. - Optimize code for efficiency and package for automated cloud-based execution Your Skills & Abilities (Required Qualifications) - Bachelor's degree in Computer Science, Mechanical Engineering, Vehicle Engineering, Physics, or a related field; or equivalent practical experience - 5+ years of experience in large scale data analyses of human and/or automated driving performance related data - 5+ years in ADAS, autonomous vehicles, robotics or related field - Experience in the following: - Programming & Frameworks : Python, SQL - Cloud & Big Data: Extensive experience in cloud-based large scale process including notifications, queuing, serverless cloud functions, event driven processing, code as infrastructure, containerization, process monitoring, process optimization, identity and access management, service to service access, etc. - Statistics: Working familiarity with descriptive statistics, managing bias in large data mining activities, experimental design, sampling strategies. - Dev Ops and Infrastructure as Code: CI/CD, versioning, Docker & Kubernetes, GitHub, Jira, Jenkins, Poetry, Terraform - Data Analysis & Visualization : Tableau, PowerBI, Plotly/Dash, Shiny, Pandas, NumPy - Proven track record providing large scale and continuous analytics development and deployment - Excellent communication and collaboration skills, with the ability to work effectively in a team environment - Strong problem-solving mindset and a proactive attitude towards learning and self-improvement What Will Give You A Competitive Edge (Preferred qualifications) - Experience in processing and analyses of large-scale vehicle motion and context related data to characterize driving performance - Record of involvement in vehicle safety related discourse through conference participation or publications. GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE. DO NOT APPLY FOR THIS ROLE IF YOU WILL NEED GM IMMIGRATION SPONSORSHIP (e.g., H-1B, TN, STEM OPT, etc.) NOW OR IN THE FUTURE. This job is not eligible for relocation benefits. Any relocation costs would be the responsibility of the selected candidate. #LI-SA2 GM does not provide immigration-related sponsorship for this role. Do not apply for this role if you will need GM immigration sponsorship now or in the future. This includes direct company sponsorship, entry of GM as the immigration employer of record on a government form, and any work authorization requiring a written submission or other immigration support from the company (e.g., H1-B, OPT, STEM OPT, CPT, TN, J-1, etc.) This role is categorized as remote. This means the selected candidate may be based anywhere in the country of work and is not expected to report to a GM worksite unless directed by their manager. The selected candidate will be required to travel <25% for this role. This job is not eligible for relocation benefits. Any relocation costs would be the responsibility of the selected candidate. About GM Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Why Join Us We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team. Total Rewards | Benefits Overview From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources. Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire. Accommodations General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us [email protected] or call us at 1-800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
• Develop and maintain robust and scalable data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse. • Design, build, and optimize data models to support analytical needs and reporting requirements. • Collaborate with data scientists to implement and deploy machine learning models and analytical solutions. • Monitor data quality and identify and resolve data integrity issues. • Contribute to the development of data documentation and metadata management practices. • Work with stakeholders to understand their data needs and translate them into technical requirements. • Assist in the evaluation and implementation of new data technologies and tools. • Participate in code reviews and contribute to the development of coding standards and best practices. • Independently manage assigned tasks and projects, ensuring timely delivery and quality results. • Proactively identify opportunities to improve data processes and systems.




