Semiconductor Insight logo
Semiconductor Insight

Pulse of Semiconductor Market : Real time Insights

Director, Data Engineering

Data EngineerData EngineerFull TimeRemoteLeadTeam 11-50Since 2016H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

28 days ago

Salary

$165 / year

Seniority

Lead

Bachelor Degree15 yrs expEnglishAzurePythonSparkSQL

Job Description

Director, Data Engineering

Semiconductor Insight

• Architect data infrastructure roadmap centered on a Lakehouse architecture • Establish data governance, cataloging, and lineage frameworks • Partner with OT and Engineering teams to operationalize IIoT and supply chain data • Oversee transition from legacy BI tools to modern analytics platforms • Lead the transition to MLOps and DataOps methodologies • Collaborate with business unit leaders to identify data products for growth • Build and mentor a high-performing team of data engineers, ML engineers, and data architects

Job Requirements

  • 15+ years in data strategy, architecture, and engineering
  • 5+ years in a leadership role managing data & analytics teams
  • Demonstrated experience designing Lakehouse architectures (e.g., Databricks, Snowflake)
  • Proven experience operationalizing AI/ML models within an enterprise environment
  • Extensive experience with Azure data stacks (e.g., Synapse/Fabric, ADLS Gen2)
  • Advanced proficiency in Python, Spark, and SQL
  • Strong experience with CI/CD for data pipelines and infrastructure-as-code
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
  • Experience with data governance frameworks and tools
  • Exposure to advanced analytics, data science, or machine learning initiatives
  • Experience in manufacturing, industrial, or eCommerce environments preferred
  • Ability to work in both office and manufacturing environments
  • Availability to work outside of core business hours, including nights, weekends, and holidays
  • Required to sit or stand for long periods of time
  • Ability to lift 30-50 lbs without assistance
  • Must have a valid driver's license and Passport.

Related Categories

Related Job Pages

More Data Engineer Jobs

Alex Staff Agency logo

Senior Data Specialist

Alex Staff Agency

We help the best professionals and companies find each other despite borders.

Data Engineer28 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Role Description We need someone who understands data deeply and uses Python to wrangle it — not a platform engineer, not a pure pipeline builder, but a data specialist who's comfortable with research, investigation, and the unglamorous work of making messy energy market data actually usable. You'll spend significant time on tasks like: - Mapping BM units to power plants and fuel types - Reconciling legacy data formats with current ones - Ensuring consistency between different Elexon message types - Cleaning time-series data (outliers, gaps, overlaps) Some of this requires genuine investigation — cross-referencing sources, making judgment calls, documenting edge cases. There's no API that solves these problems for you. Python is your primary tool (Pandas, Numpy, standard libraries) to minimise manual effort, but you should be comfortable that some detective work is unavoidable. If you find satisfaction in truly understanding a dataset's structure and quirks — rather than just piping data through and hoping for the best — this role is for you. Qualifications - Strong Python skills for data work — fluent with pandas, comfortable writing clean, testable code, and can build reusable data processing logic. - Solid SQL skills — complex queries, window functions, CTEs in PostgreSQL. - Experience with messy, real-world data — reconciliation, cleaning, or mapping work. - Methodical and detail-oriented — notice inconsistencies and want to understand root causes. - Good documentation habits — understanding that undocumented mappings and assumptions are technical debt. - Self-directed — able to own ambiguous problems, do research, and communicate findings clearly. Requirements - Map BM units from Elexon to their corresponding power plants, substations, and fuel types. - Map substations to ETYS zones and grid supply points. - Build and maintain reference/master datasets that link identifiers across disparate sources. - Document mappings, assumptions, and known limitations clearly for downstream users. - Reconcile legacy data formats with current formats. - Ensure consistency between different Elexon message types. - Investigate discrepancies between data sources and determine authoritative values. - Clean time-series data: detect outliers, fill gaps appropriately, resolve overlapping or duplicate timestamps. - Develop reusable Python-based cleaning routines that can be applied across datasets. - Write and maintain Python data grabbers for energy market APIs. - Build dbt models to transform raw data into clean, analysis-ready datasets. - Orchestrate workflows via GitHub Actions. - Design PostgreSQL schemas that reflect your understanding of the domain. Benefits - Remote-first with async collaboration (Slack, GitHub, documented decisions). - Core overlap with UK business hours expected (at least 4 hours daily). - Competitive compensation based on location and experience. - Plenty of opportunities for learning and professional growth. - B2B contract with a paid vacation.

UTC-5 to UTC-3 + 2 moreAll locations: UTC-5 to UTC-3 | GMT (UTC+0) | EET (UTC+2)
ContractRemoteTeam 1,001-5,000H1B Sponsor

• Design and implement enterprise data architecture leveraging Snowflake for structured and unstructured data • Develop scalable data models, data lakes, and data warehouses to support analytics, AI/ML, and reporting • Define and enforce data governance, security, and compliance frameworks (HIPAA, FDA, GDPR) • Architect data pipelines and ETL/ELT processes using modern tools (e.g., Snowpipe, dbt, Informatica, Azure Data Factory) • Collaborate with cross-functional teams (Engineering, Clinical, Regulatory, Quality, and Business stakeholders) • Ensure data integrity, lineage, and traceability aligned with medical device standards (e.g., ISO 13485, GxP) • Optimize Snowflake performance, cost management, and workload management • Support cloud data architecture (AWS, Azure, or GCP) and hybrid environments • Enable advanced analytics, including AI/ML and real-world evidence (RWE) use cases • Establish best practices for data lifecycle management (ingestion, storage, archival, and retention)

India
ELEKS logo

Senior Data Engineer – New Opening

ELEKS

The Custom Software Development Company

Data Engineer28 days ago
Full TimeRemoteTeam 1,001-5,000Since 1991H1B Sponsor

• Design, develop, and maintain reliable software in line with technical requirements, focusing on performance and availability • Analyze requirements, review designs, and estimate user stories following project methodology (Agile, Waterfall, etc) • Proactively propose code refactoring and optimization improvements according to the best software development practices and coding standards • Help maintain and improve high-quality standards within the developer community by sharing knowledge, conducting tech talks, and participating in the internal promotion verification process • Stay up-to-date with modern technology and obtain professional certifications • Support less experienced developers by providing training, distributing, and monitoring tasks

Argentina

Senior Data Engineer

UL Solutions

Founded in 1894, UL Solutions is self-described as a global leader in applied safety science and provides high-quality product safety evaluations. For over a century, the company h

Data Engineer28 days ago
Full TimeRemoteTeam 15,000Since 1894

Role Description The Senior Data Engineer is a critical role in growing the data maturity of the lab organization at UL Solutions. This is a remote-based role and can be located in either Italy or Poland. - Develop ETL/ELT pipelines and data warehousing. - Collaborate closely with product, technology teams, and management to design and validate the capabilities of the data platform. - Profile and analyze data in designing scalable solutions. - Leverage technologies such as the Azure BI Stack and Power BI visualization platforms. - Analyze, develop, and maintain data pipelines from internal and external sources. - Apply and build automated test-driven development, continuous integration/delivery, and version control best practices. - Manage, monitor, and troubleshoot data pipeline infrastructure. Qualifications - Proven track record of developing ETL/ELT pipelines. - Experience with disparate data types, including legacy databases and documents using popular open-source software. - Proactive and innovative approach to problem-solving. - Commitment to continuous improvement in data processing and orchestration. Requirements - Experience with Azure BI Stack and Power BI visualization platforms. - Familiarity with modern developer tools for executing innovative solutions. Benefits - Opportunity to work in a multidisciplinary team. - Remote work flexibility. Company Description A global leader in applied safety science, UL Solutions (NYSE: ULS) transforms safety, security, and sustainability challenges into opportunities for customers in more than 110 countries. UL Solutions delivers testing, inspection, and certification services, together with software products and advisory offerings, that support our customers’ product innovation and business growth. - The UL Mark serves as a recognized symbol of trust in our customers’ products. - We help our customers innovate, launch new products and services, navigate global markets and complex supply chains, and grow sustainably and responsibly into the future. - Our science is your advantage.

Illinois + 2 moreAll locations: Illinois | Poland | Italy
$160K / year