IntegriChain logo
IntegriChain

Data-Driven Commercialization

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 501-1,000H1B SponsorCompany SiteLinkedIn

Location

Pennsylvania

Posted

2 days ago

Salary

0

Seniority

Senior

Bachelor Degree10 yrs expEnglishCloudETLPythonSQL

Job Description

Senior Data Engineer

IntegriChain

• Help define and mature data integration, data consolidation, MDM integration, and data platform design patterns across Integrichain. • Design, build, optimize, and operate Snowflake data models, pipelines, stored procedures, and high-volume data processing patterns. • Partner with MDM and Product teams to support HCO Master data ingestion, outbound extracts, cross-reference data, golden record consumption, survivorship outputs, and downstream publishing patterns. • Work with Product, Engineering, MDM, Data Science, DevOps, Security, and business stakeholders to align data solutions to enterprise priorities. • Use dbt or similar ELT tooling to develop reliable, maintainable, testable, and observable data pipelines. • Drive Snowflake performance tuning, warehouse sizing, workload management, cost tracking, and cost optimization practices. • Partner with Data Science leadership to rationalize and consolidate the enterprise data landscape across products, platforms, and acquired capabilities. • Define reusable data integration patterns for batch, micro-batch, near-real-time, and application-to-application data exchange. • Collaborate with cross-functional teams to understand business data needs, source-system realities, and enterprise application integration requirements. • Design scalable patterns for ingesting, transforming, mastering, and publishing data across operational and analytical use cases. • Help establish standards for data contracts, schema evolution, data quality, lineage, and data ownership. • Design and build data pipelines that load source data into Reltio MDM and extract mastered outputs from Reltio for downstream Snowflake, analytics, AI, and operational use cases. • Partner with MDM configuration and Product Management teams to translate HCO mastering requirements into data pipeline, mapping, validation, reconciliation, and publishing patterns. • Work with Reltio APIs, exports, crosswalks/XREFs, event-based integration patterns, and bulk load/extract mechanisms as needed to support inbound and outbound data flows. • Engineer integration patterns for HCO Master data, including party/entity, address, identifier, hierarchy, relationship, match/merge, survivorship, and golden record outputs. • Support source ingestion and reference data integration involving datasets such as HIN, DEA, NPI, NCPDP, 340B/PHS, channel outlet data, customer/account data, and other life sciences master/reference sources. • Develop validation and reconciliation processes to compare source data, Reltio mastered data, Snowflake curated data, and downstream consumption layers. • Help operationalize MDM outputs for business-facing data products, semantic models, reporting tables, APIs, and AI-ready datasets. • Design Snowflake database, schema, table, view, and semantic-layer patterns that support performance, governance, and maintainability. • Optimize Snowflake workloads using clustering, micro-partition awareness, warehouse sizing, query profiling, caching behavior, and workload isolation. • Implement Snowflake cost tracking and optimization practices, including warehouse utilization monitoring, inefficient query identification, and cost allocation by workload, team, or use case. • Build scalable SQL and Snowflake stored procedure logic for large-volume data processing and analytical workloads. • Apply secure Snowflake design patterns including RBAC, masking, access isolation, auditing, and environment separation. • Design, build, and maintain reliable ELT pipelines using dbt or comparable modern data transformation tooling. • Develop Python-based automation for API integration, file processing, metadata management, validation, orchestration support, and operational tooling. • Develop modular, tested, and reusable transformation models for raw, curated, mastered, and business-ready data layers. • Implement automated data quality checks, source freshness checks, reconciliation, logging, and exception-handling patterns. • Build orchestration-ready pipelines that support dependency management, restartability, incremental loads, and operational monitoring. • Collaborate with DevOps/SRE teams on CI/CD, deployment automation, environment promotion, and operational runbooks for data pipelines. • Spearhead logical and physical data modeling efforts for enterprise analytical, operational, MDM, and AI-ready datasets. • Design models that balance normalization, dimensional modeling, medallion/lakehouse concepts, and application-specific consumption needs. • Create denormalized reporting and semantic-model-ready structures that simplify business consumption and reduce ambiguity for AI/LLM use cases. • Process and optimize large data volumes in Snowflake using efficient SQL, PL/SQL-style procedural logic, Snowflake Scripting, and performance-aware design. • Create reusable patterns for historical tracking, snapshots, audit columns, data versioning, and lifecycle management. • Ensure data models support downstream BI, AI/ML, semantic models, data apps, MDM Explorer/Entity 360 use cases, and enterprise reporting.

Job Requirements

  • 10+ years of experience in data engineering, database engineering, analytics engineering, or data platform development in production environments.
  • Strong hands-on experience with Snowflake, including architecture, performance tuning, security design, cost optimization, and cost tracking.
  • Thorough understanding of Snowflake design patterns for analytical workloads, high-volume data processing, data sharing, and multi-environment deployments.
  • Hands-on experience with ETL/ELT tools; dbt experience is strongly preferred.
  • Strong SQL and PL/SQL-style development experience, including complex transformations, stored procedures, performance tuning, and large-scale data processing.
  • Python experience for data automation, API integration, file handling, data validation, metadata processing, or operational tooling.
  • Experience designing and implementing enterprise data models, curated data layers, semantic layers, and reusable data products.
  • Experience with data integration patterns across enterprise applications, APIs, files, cloud storage, operational systems, MDM platforms, and analytical platforms.
  • Working understanding of Master Data Management concepts such as golden records, crosswalks/XREFs, match/merge, survivorship, hierarchies, entity relationships, stewardship, and data quality.
  • Experience partnering with MDM, Product, or business teams to translate mastering requirements into source-to-target mappings, transformation logic, validations, and downstream data consumption patterns.
  • Ability to work directly with cross-functional stakeholders to gather requirements, explain design tradeoffs, and drive alignment.
  • Experience implementing data quality, lineage, auditability, observability, and operational monitoring within data pipelines.
  • Comfortable operating as a hands-on senior individual contributor who can also influence strategy and engineering standards.

Benefits

  • Excellent and affordable medical benefits
  • Flexible Paid Time Off
  • Robust Learning & Development opportunities including over 700+ development courses free to all employees

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 1,001-5,000Since 1999H1B No Sponsor

• Co-define and evolve the data platform roadmap in collaboration with architecture and engineering teams • Translate technical and business requirements into epics, user stories, and technical backlog items • Work closely with Data Engineers and Architects on: data models and architectures (batch/streaming) data pipelines and ingestion frameworks storage (e.g. data lake / data warehouse) and processing layers • Support design and implementation of platform components for: machine learning workflows (MLOps, feature stores, model lifecycle) data observability, lineage, and quality monitoring • Ensure datasets are reliable, well-structured, and ready for analytics and ML use cases • Participate in technical discussions and architecture decisions (not just coordination) • Drive delivery in an agile setup (planning, backlog refinement, prioritisation) • Communicate technical concepts in a clear way to non-technical stakeholders

Poland
The Hanover Insurance Group logo

Associate Data Engineer

The Hanover Insurance Group

For more than 170 years, The Hanover has been committed to delivering on our promises and being there when it matters the most. We live our values every day, demonstrating we CARE through our values, Sustainability initiatives and inclusive corporate culture.

Data Engineer2 days ago
Full TimeRemoteTeam 5,001-10,000

Role Description This role will primarily become proficient with all internal & external data produced and consumed by Hanover’s Core Commercial and Specialty businesses. This role will drive complex projects independently as well as under the mentorship of experienced engineers. The Associate Data Engineer will collaborate with business partners and cross-functional teams on data and reporting requests. The assignments will become broader in nature, usually requiring originality and ingenuity. This role will be accountable for successful outcomes related to designing, developing, implementing, optimizing, and maintaining data integrations, pipelines and solutions. IN THIS ROLE, YOU WILL: - Complete data integration and build scalable ETL pipelines - Learn data engineering best practices for data storage, integration, transformation, and access within cloud and on-premises platforms - Gain a strong understanding of Medallion Architecture and Data Lake best practices - Ensure data security and compliance within industry standards - Develop and maintain documentation for data integration and ETL solutions - Build solutions within Azure Data Services (Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage) - Create solutions using pySpark/SparkSQL, and Delta Tables - Collaborate with data scientists, analysts, and stakeholders - Work within agile development methodologies - Occasional Power BI report creation for data delivery - Utilize best practices for CI/CD Qualifications - Bachelor’s degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or other related fields - 0-2 years professional experience in data engineering, data architecture, and/or data analytics - Beginner proficiency in SQL and Python - Strong problem-solving, communication, and collaboration skills - Critical thinking and attention to detail - Must be eligible to work in the United States without requiring sponsorship now or in the future (i.e. US Citizen or green card holder) Requirements - Some experience working with Azure, AWS, GCP, or other cloud - CI/CD experience with ADO or Github - Azure Synapse Analytics and/or Microsoft Fabric experience - PowerBI experience - Insurance industry experience Benefits - Medical, dental, vision, life, and disability insurance - 401K with a company match - Tuition reimbursement - PTO - Company paid holidays - Flexible work arrangements - Cultural Awareness Day in support of IDE - On-site medical/wellness center (Worcester only)

United States
$58K - $75K / year
Pew Charitable Trusts logo

Senior Associate, Public Health Data Improvement

Pew Charitable Trusts

The Pew Charitable Trusts is an independent, nonprofit organization with assets totaling $4.7 billion. The organization is committed to solving some of the most

Data Engineer2 days ago

Conduct policy research to develop recommendations for improving public health data collection and analysis. Monitor federal and state initiatives, and draft communications to support stakeholder engagement and project objectives.

District Of Columbia
Graebel Companies, Inc. logo

Data Engineer

Graebel Companies, Inc.

Are you ready to open a world of opportunity in talent mobility? Our clients include some of the largest and most recognized brands in the world. They’re innovators and leaders in their industries, making life-enhancing breakthroughs every day. We help them tap into those opportunities by placing their exceptional people where they need to be, anywhere in the world. When it comes to service, we set the bar for exceptional … and then we raise it with fresh ideas, leading tools and innovative approaches, and it’s all grounded in our values of truth, love, and integrity. We call it People-first Mobility. We’re looking for exceptional people who share those values along with our passion for delivering the highest levels of service. If that sounds like you, and if you’re ready for a new career opportunity, we’d like to hear from you!

Data Engineer2 days ago
Full TimeRemoteTeam 1,001-5,000

Role Description As a Data Engineer, you play a vital role in our commitment to data-driven decision-making. Your responsibilities involve designing and implementing projects that consolidate data from various sources, facilitating analysis and informed decision-making. Your primary focus is ensuring that data is easily accessible and user-friendly, allowing for both routine and ad-hoc analysis. - Collaborate with colleagues and clients to provide the necessary tools for routine and non-routine data analysis. - Accelerate all efforts through leveraging AI. - Translate business requirements into technical solutions, drawing on your strong business acumen. - Analyze current business practices, processes, and procedures to identify future opportunities. - Assess client needs to create customized data design services. - Offer exceptional support to our business partners. - Develop the foundational components for evolving enterprise data solutions. - Architect and construct modern data pipelines. - Implement effective metrics and monitoring systems. - Make independent decisions and provide guidance to your peers. - Create and promote technical best practices for modeling and report design. - Perform any other related duties as required or assigned. Company Description Are you ready to open a world of opportunity in talent mobility? Our clients include some of the largest and most recognized brands in the world. They’re innovators and leaders in their industries, making life-enhancing breakthroughs every day. We help them tap into those opportunities by placing their exceptional people where they need to be, anywhere in the world. When it comes to service, we set the bar for exceptional … and then we raise it with fresh ideas, leading tools and innovative approaches, and it’s all grounded in our values of truth, love, and integrity. We call it People-first Mobility. We’re looking for exceptional people who share those values along with our passion for delivering the highest levels of service. If that sounds like you, and if you’re ready for a new career opportunity, we’d like to hear from you! Here’s to the world ahead.

United States
$105K - $115K / year