Job Closed

This listing is no longer active.

thyssenkrupp logo
thyssenkrupp

engineering. tomorrow. together.

Data Engineer

Data EngineerData EngineerOtherRemoteJuniorTeam 10,001+Since 1811H1B SponsorCompany SiteLinkedIn

Location

Michigan

Posted

167 days ago

Salary

0

Seniority

Junior

Bachelor Degree1.1 yrs expEnglishAirflowAzureETLITSMMatillionPythonSQL

Job Description

Data Engineer

thyssenkrupp

• Develop, maintain, and monitor data ingestion and enrich ETL/ELT pipelines within the platform that load and convert raw data into data products. • Partner with regional and/or global IT infrastructure teams to support and configure data platform storage and compute layers. • Maintain and build CI/CD pipeline code and automated test plans to ensure automated deployment between development and production environments. • Manage data platforms related to ITSM ticketing processes (incident & change requests). • Collaborate with data team members, architects, data stewards, data owners, and business SMEs to develop data product business requirements for data cleansing and enrichment. • Implement data security and data governance policies within the data platform to protect sensitive information and maintain data quality. • Partner with cybersecurity and compliance teams to rigorously ensure compliance with applicable data security, data protection, and regulation requirements. • Partner with global data teams to ensure that the local data platform & products maintain interoperability. • Continuously identify and drive opportunities to improve platform performance, reduce complexity and technical debt and reduce cloud computing and storage costs. • Maintain support documentation within the team repository. • Escalate data platform issues to the attention of management / appropriate partners. • Leverage agile frameworks and Azure DevOps to execute the team backlog. • Implement data platform metadata management standards and policies.

Job Requirements

  • Bachelor’s degree, or equivalent work experience.
  • Minimum 1+ years of experience in IT Industry and 1 year of experience as a Data Engineer or equivalent work experience.
  • At least 1 year of prior data engineering experience of building ETL/ELT data pipelines using Airflow, Fivetran, Qlik, DBT, ADF, Snowpipe, Matillion and/or similar tools to load and transform structure and semi-structured data.
  • At least 1 year of experience building and supporting cloud native databases, warehouses data lakes, lake houses, and/or data repositories.
  • At least 1 year of experience writing python and/or SQL to manipulate, transform, and load large disparate data sets.
  • Advanced working SQL knowledge and prior experience loading data into relational databases, data warehouses, and/or data lakes on Microsoft Azure Cloud or other cloud platform.
  • Ability to concisely and completely document business requirements into user stories within Azure DevOps and create related technical documentation.
  • Basic working knowledge of implementing identity and access management (IAM) and data object, column, and row level access controls to protect sensitive information.
  • Fundamental understanding of implementing DevOPs, code management, versioning/branching, and automated testing concepts.
  • Experience with leveraging IDEs (e.g., Visual Studio Code and/or Snowflake Notebooks).
  • Have a fundamental understanding of how to effectively leverage elastic compute and interoperable storage to scale data pipelines/processing up and out.
  • Strong project management and organizational skills.
  • Experience with performing root cause analysis to answer specific business questions, resolve issues, & identify improvement opportunities.
  • Experience designing and implementing relational, star schema, and snowflake data models.
  • Excellent verbal and written communication skills; ability to provide meaningful, regular status communications to various levels of leadership.
  • Proven track record of driving continuous personal improvement by learning and adapting quickly to the latest technologies and trends.
  • Familiarity with SAP supply chain data and/or within aerospace is preferred but not required.

Benefits

  • Medical, Dental, Vision Insurance
  • Life Insurance and Disability
  • Voluntary Wellness Programs
  • 401(k) and RRSP programs with Company Match
  • Paid Vacation and Holidays
  • Tuition Reimbursement
  • And more! Benefits may vary based on job, country, union role, and/or company segment.

Related Categories

Related Job Pages

More Data Engineer Jobs

Relai 🇨🇭 logo

Senior Data Engineer

Relai 🇨🇭

Take control of your future

Data Engineer167 days ago
Full TimeRemoteTeam 11-50Since 2020H1B No Sponsor

• Design and build our data warehouse • Build ETL/ELT pipelines • Take full ownership of the data structure and handling • Take care of our internal dashboard used by several departments at Relai • Implement internal features of the dashboard such as performing actions related to users or transactions • Implement the back-end endpoints related to these actions

Europe
Job Closed
Blue Coding logo

Senior Data Engineer – V

Blue Coding

Top notch developers, ready to deploy.

Data Engineer167 days ago
ContractRemoteTeam 51-200Since 2014H1B No Sponsor

• Design, develop, and maintain data pipelines and datastores that support enterprise analytics, data science, and operational workloads. • Lead and support large-scale database migration initiatives, including on-premises to cloud migrations. • Monitor, analyze, and optimize the performance and stability of data layer services and platforms. • Ensure data integrity, quality, and compliance across pipelines and datasets. • Collaborate closely with peers across engineering, analytics, and technology teams. • Guide, coach, and mentor data engineers, BI developers, and analysts. • Design and implement enterprise-scale data solutions with long-term business impact. • Build and maintain data processing solutions using Python and/or Scala. • Work with a variety of data ingestion patterns, including SFTP, APIs, streaming, and batch processing. • Design and support database models optimized for analytical and reporting use cases. • Implement monitoring, alerting, and observability for data pipelines and infrastructure. • Maintain clear and comprehensive documentation of data architectures, pipelines, and processes. • Work within an Agile environment, collaborating through tools such as Jira and Git.

Latin America
Job Closed
OtherRemoteTeam 51-200Since 2012H1B No Sponsor

• Maintain and optimize cloud infrastructure to ensure reliability and scalability for data systems. • Extract, transform, and load (ETL) data across various systems to support business operations and decision-making. • Identify and resolve issues within existing systems to enhance performance, stability, and scalability. • Troubleshoot and fix bugs in deployed systems, ensuring minimal downtime and disruption. • Optimize systems and streamline existing processes to improve efficiency and reduce latency. • Build and optimize system deployment structures to ensure smooth, consistent deployments and system performance.

United States
Job Closed
eSimplicity logo

ETL Pipeline Developer, Data Engineer

eSimplicity

An engineering firm that delivers high-quality Healthcare IT, Cybersecurity, and Telecommunication solutions.

Data Engineer167 days ago
OtherRemoteTeam 51-200Since 2016H1B No Sponsor

• Work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for data and analytics platform. • Create and maintain new and existing data pipelines, Extract, Transform, and Load (ETL) processes, and ETL features using Azure cloud services. • Build, expand, and optimize data and data pipeline architectures. • Optimize data flow and collection for cross functional teams of database architects, data analysts, and data scientists. • Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality. • Assemble large, complex sets of data that meet non-functional and functional business requirements. • Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes. • Develop and document standard operating procedures (SOPs) for new and existing data pipelines. • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition. • Write unit and integration tests for all data processing code. • Read data specifications and translate them into code and design documents.

United States
$110 / hour
Job Closed