Senior Manager, Data Engineering
Location
United States
Posted
1 day ago
Salary
0
Seniority
Lead
Job Description
Senior Manager, Data Engineering
Independence Pet Holdings
Role Description We are seeking an experienced and hands-on Senior Manager, Data Engineering to lead the strategy, architecture, and execution of Clarus' modern data platform. This role will be responsible for building and scaling foundational data capabilities across data ingestion, master data management (MDM), data quality, and platform engineering. As a growing organization, Clarus values leaders who can balance strategic thinking with hands-on execution. The ideal candidate thrives in fast-paced environments, enjoys solving complex data challenges, and is excited to build scalable data foundations that enable products, analytics, operational workflows, and business decision-making. This role will partner closely with Engineering, Product, Analytics, and business leaders to establish trusted, high-quality data assets and deliver a data platform capable of supporting Clarus' next stage of growth. Key Responsibilities - Define and execute the roadmap for data engineering capabilities aligned with business and product priorities. - Design, build, and optimize scalable batch and real-time data ingestion frameworks using Azure Databricks, ADLS Gen2, and Azure-native technologies. - Establish reusable data engineering patterns, orchestration standards, and platform best practices. - Drive reliability, observability, performance optimization, and cost efficiency of data pipelines and infrastructure. - Lead the strategy and implementation of Master Data Management (MDM) capabilities across key business domains. - Define and govern trusted data assets and golden records for critical business entities including customers, products, providers, and partners. - Partner with business, product, and analytics stakeholders to ensure consistent and trusted enterprise data. - Develop scalable approaches for entity resolution, matching, taxonomy management, and hierarchical data modeling. - Champion modern lakehouse architecture principles and modular data design. - Establish robust data quality frameworks, monitoring, SLAs, and operational support processes. - Ensure alignment with enterprise governance, security, privacy, and regulatory requirements. - Lead, mentor, and grow a team of data engineers while fostering a culture of ownership, collaboration, and continuous improvement. - Contribute directly to architecture decisions, technical design, and critical implementation efforts when needed. - Drive agile delivery, sprint planning, and engineering best practices across the team. - Establish CI/CD standards, testing strategies, and DataOps best practices to support platform scalability and reliability. Qualifications - Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. - 10+ years of experience in data engineering, data platform development, or related disciplines. - 2+ years of experience leading technical teams, mentoring engineers, or serving in a technical leadership capacity. - Deep experience with Azure cloud data platforms, including Azure Databricks, ADLS Gen2, Azure Data Factory, Event Hub, and related services. - Strong experience building modern data platforms, lakehouse architectures, and distributed data processing solutions. - Experience developing and implementing Master Data Management (MDM) solutions and enterprise data models. - Expertise with SQL, Python, Spark, and modern data engineering frameworks. - Experience building and supporting both batch and real-time data processing pipelines. - Strong understanding of data governance, metadata management, data quality, and security best practices. - Experience implementing CI/CD pipelines, DevOps practices, and infrastructure automation. - Excellent communication skills with the ability to influence technical and non-technical stakeholders. - Experience in healthcare, insurance, pet health, or other highly regulated industries is a plus. - Experience with entity resolution, probabilistic matching, or customer data platforms is a plus. Benefits - Comprehensive full medical, dental and vision Insurance - Basic Life Insurance at no cost to the employee - Company paid short-term and long-term disability - 12 weeks of 100% paid Parental Leave - Health Savings Account (HSA) - Flexible Spending Accounts (FSA) - Retirement savings plan - Personal Paid Time Off - Paid holidays and company-wide Wellness Day off - Paid time off to volunteer at nonprofit organizations - Pet friendly office environment - Commuter Benefits - Group Pet Insurance - On the job training and skills development - Employee Assistance Program (EAP)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Principal Technical Product Manager, Data Platform
SandboxAQLeveraging AQ - the powerful compound effects of AI + Quantum technology
• Define and own the Data Platform roadmap across ingestion, auto-detection, schema reconciliation, and lineage • Own the CRO and lab-partner ingestion-template product and the auto-matching UX, so partner data is usable the moment it lands • Drive dataset-level provenance, sensitivity tagging, and field-of-use governance • Design experiment-integration API schemas in partnership with the BioSim and ChemSim teams • Own the federated data-management product that enables IP-safe data sharing across partners • Define and track the metrics that matter including but not limited to time-to-usable per dataset, auto-match accuracy, and lineage completeness
• Lead a high-performing team responsible for delivering complex healthcare data migration and integration solutions • drive technical excellence, build scalable delivery capabilities, and help modernize imaging environments • Lead, mentor, and grow a team of Data Migration and Integration professionals • Establish and improve standardized delivery methodologies, governance, and best practices • Partner closely with Project Management, Engineering, Clinical Consulting, Customer Success, Technical Services, and implementation partners • Build and manage strategic relationships with third-party implementation partners • Drive continuous improvement through resource planning, capacity management, key performance indicators, technical leadership, and customer engagement
• Manage Projects & Technology • Lead and implement Data Receipt Agreements with vendors in collaboration with cross-functional teams • Program and establish import procedures for data ingestion using SAS or alternative technologies (e.g., Workbench) • Design and implement reconciliation checks to ensure accurate data transfer • Program offline listings and custom reports to provide valuable insights on external data • Aggregate data across all sources and manage data structures, missing values, and programming errors • Review data outputs and provide strategic insights to study teams and clients • Ensure first-time quality on all deliverables • Negotiate electronic data timelines and ensure adherence through active project management • Monitor project resourcing, identify scope changes, and resolve technical issues • Coordinate and lead programming teams to successful project completion within timelines and budget • Manage deployment of data management technology for offline listing creation • Act as SME and technology owner for data management offline listing platforms • Maintain comprehensive supporting documentation in accordance with SOPs, Guidelines, and Work Instructions • Ensure traceability and regulatory compliance across all study activities • Document deviations and communicate them to project teams • Support Initiatives & Continuous Improvement • Participate in creating standards through tools (SAS macros), libraries, and processes • Develop and implement project-specific tools and improvements • Lead or drive global initiatives related to processes and new technologies • Mentor staff and provide relevant training • Assist project teams in problem resolution and technical support • Maintain and expand regulatory knowledge within the clinical research industry • Serve as point of contact for clients and internal stakeholders on electronic data matters • Participate in bid defense meetings • Independently contribute ideas on technology and data engineering to support business development
• Explore legacy source systems to understand their structure, quality, and relationships. • Export source data across a range of access methods. • Transform exported data into gaiia's standard format. • Execute migrations end-to-end on the internal migration platform. • Build and reuse mappings, templates, and validation rules. • Contribute small engineering improvements to the migration tooling. • Diagnose and resolve data discrepancies during dry runs, UAT, and post-cutover. • Document mapping specs, transformation logic, and data anomalies.



