Job Closed
This listing is no longer active.
engineering. tomorrow. together.
Data Engineer
Location
Michigan
Posted
167 days ago
Salary
0
Seniority
Junior
Job Description
Data Engineer
thyssenkrupp
• Develop, maintain, and monitor data ingestion and enrich ETL/ELT pipelines within the platform that load and convert raw data into data products. • Partner with regional and/or global IT infrastructure teams to support and configure data platform storage and compute layers. • Maintain and build CI/CD pipeline code and automated test plans to ensure automated deployment between development and production environments. • Manage data platforms related to ITSM ticketing processes (incident & change requests). • Collaborate with data team members, architects, data stewards, data owners, and business SMEs to develop data product business requirements for data cleansing and enrichment. • Implement data security and data governance policies within the data platform to protect sensitive information and maintain data quality. • Partner with cybersecurity and compliance teams to rigorously ensure compliance with applicable data security, data protection, and regulation requirements. • Partner with global data teams to ensure that the local data platform & products maintain interoperability. • Continuously identify and drive opportunities to improve platform performance, reduce complexity and technical debt and reduce cloud computing and storage costs. • Maintain support documentation within the team repository. • Escalate data platform issues to the attention of management / appropriate partners. • Leverage agile frameworks and Azure DevOps to execute the team backlog. • Implement data platform metadata management standards and policies.
Job Requirements
- Bachelor’s degree, or equivalent work experience.
- Minimum 1+ years of experience in IT Industry and 1 year of experience as a Data Engineer or equivalent work experience.
- At least 1 year of prior data engineering experience of building ETL/ELT data pipelines using Airflow, Fivetran, Qlik, DBT, ADF, Snowpipe, Matillion and/or similar tools to load and transform structure and semi-structured data.
- At least 1 year of experience building and supporting cloud native databases, warehouses data lakes, lake houses, and/or data repositories.
- At least 1 year of experience writing python and/or SQL to manipulate, transform, and load large disparate data sets.
- Advanced working SQL knowledge and prior experience loading data into relational databases, data warehouses, and/or data lakes on Microsoft Azure Cloud or other cloud platform.
- Ability to concisely and completely document business requirements into user stories within Azure DevOps and create related technical documentation.
- Basic working knowledge of implementing identity and access management (IAM) and data object, column, and row level access controls to protect sensitive information.
- Fundamental understanding of implementing DevOPs, code management, versioning/branching, and automated testing concepts.
- Experience with leveraging IDEs (e.g., Visual Studio Code and/or Snowflake Notebooks).
- Have a fundamental understanding of how to effectively leverage elastic compute and interoperable storage to scale data pipelines/processing up and out.
- Strong project management and organizational skills.
- Experience with performing root cause analysis to answer specific business questions, resolve issues, & identify improvement opportunities.
- Experience designing and implementing relational, star schema, and snowflake data models.
- Excellent verbal and written communication skills; ability to provide meaningful, regular status communications to various levels of leadership.
- Proven track record of driving continuous personal improvement by learning and adapting quickly to the latest technologies and trends.
- Familiarity with SAP supply chain data and/or within aerospace is preferred but not required.
Benefits
- Medical, Dental, Vision Insurance
- Life Insurance and Disability
- Voluntary Wellness Programs
- 401(k) and RRSP programs with Company Match
- Paid Vacation and Holidays
- Tuition Reimbursement
- And more! Benefits may vary based on job, country, union role, and/or company segment.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design and build our data warehouse • Build ETL/ELT pipelines • Take full ownership of the data structure and handling • Take care of our internal dashboard used by several departments at Relai • Implement internal features of the dashboard such as performing actions related to users or transactions • Implement the back-end endpoints related to these actions
• Design, develop, and maintain data pipelines and datastores that support enterprise analytics, data science, and operational workloads. • Lead and support large-scale database migration initiatives, including on-premises to cloud migrations. • Monitor, analyze, and optimize the performance and stability of data layer services and platforms. • Ensure data integrity, quality, and compliance across pipelines and datasets. • Collaborate closely with peers across engineering, analytics, and technology teams. • Guide, coach, and mentor data engineers, BI developers, and analysts. • Design and implement enterprise-scale data solutions with long-term business impact. • Build and maintain data processing solutions using Python and/or Scala. • Work with a variety of data ingestion patterns, including SFTP, APIs, streaming, and batch processing. • Design and support database models optimized for analytical and reporting use cases. • Implement monitoring, alerting, and observability for data pipelines and infrastructure. • Maintain clear and comprehensive documentation of data architectures, pipelines, and processes. • Work within an Agile environment, collaborating through tools such as Jira and Git.
• Maintain and optimize cloud infrastructure to ensure reliability and scalability for data systems. • Extract, transform, and load (ETL) data across various systems to support business operations and decision-making. • Identify and resolve issues within existing systems to enhance performance, stability, and scalability. • Troubleshoot and fix bugs in deployed systems, ensuring minimal downtime and disruption. • Optimize systems and streamline existing processes to improve efficiency and reduce latency. • Build and optimize system deployment structures to ensure smooth, consistent deployments and system performance.
ETL Pipeline Developer, Data Engineer
eSimplicityAn engineering firm that delivers high-quality Healthcare IT, Cybersecurity, and Telecommunication solutions.
• Work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for data and analytics platform. • Create and maintain new and existing data pipelines, Extract, Transform, and Load (ETL) processes, and ETL features using Azure cloud services. • Build, expand, and optimize data and data pipeline architectures. • Optimize data flow and collection for cross functional teams of database architects, data analysts, and data scientists. • Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality. • Assemble large, complex sets of data that meet non-functional and functional business requirements. • Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes. • Develop and document standard operating procedures (SOPs) for new and existing data pipelines. • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition. • Write unit and integration tests for all data processing code. • Read data specifications and translate them into code and design documents.




