• Lead and guide the design and implementation of scalable distributed systems based on Java microservices • Engineer and optimize data pipelines using solutions like Apache Hudi, Apache Trino, Azure ADLS • Collaborate cross-functionally with product, analytics, and AI teams to ensure data is a strategic asset • Advance ongoing modernization efforts, deepening adoption of event-driven architectures and cloud-native technologies • Drive adoption of best practices in data governance, observability, and performance tuning for data workloads • Embed data quality in processing pipelines by defining schema contracts, implementing transformation tests and data assertions, enforcing backward-compatible schema evolution, and automating checks for freshness, completeness, and accuracy across batch and streaming paths before production deployment • Establish robust observability for data pipelines by implementing metrics, logging, and distributed tracing for streaming jobs, defining SLAs and SLOs for latency and throughput, and integrating alerting and dashboards to enable proactive monitoring and rapid incident response • Foster a culture of quality through peer reviews, providing constructive feedback and seeking input on your own work

Role Description At Deputy, our mission is to simplify shift work and create thriving workplaces. Data is at the heart of how we achieve this, powering everything from product innovation to exceptional customer experiences. We are looking for a Principal Data Engineer to be the technical cornerstone of our data team, leading the charge in building a scalable and reliable data platform that will support our next phase of growth. This is a foundational, strategic role. You will have the autonomy to shape our data architecture, champion engineering best practices, and set the technical vision for how we use data across the company. This role is a perfect blend of hands-on technical leadership and strategic influence, where you will not only build powerful data systems but also mentor a talented team and partner with leaders across the business. Responsibilities - Architect and Evolve Our Core Data Platform - Own the technical vision and roadmap for our data platform. - Design, implement, and refine a robust data lakehouse architecture (e.g., Medallion) using Databricks and Delta Lake. - Develop and maintain resilient, reusable patterns for ingesting data from diverse sources. - Lead the implementation of core data modelling principles (e.g., Kimball dimensional modelling). - Use tools like Unity Catalog to establish a comprehensive data governance framework. - Develop strategies for monitoring, optimising, and forecasting Databricks and cloud expenditure. - Champion Engineering Excellence and Best Practice - Implement and advocate for automated CI/CD pipelines (e.g., using GitHub Actions). - Champion a Git-first culture for all data transformation code. - Implement comprehensive, automated data quality testing at every stage of our pipelines. - Establish thorough monitoring, logging, and alerting for all data pipelines. - Be a Strategic Partner Across the Business - Collaborate with leaders in Product, Engineering, Sales, finance, and Customer Success. - Advise analysts, data scientists, and stakeholders on leveraging the data platform. - Serve as the go-to expert on our data architecture. - Lead, Mentor, and Elevate Our Data Team - Actively mentor data analysts and engineers through pair programming and code reviews. - Lead initiatives like a 'data guild' for knowledge sharing. - Partner with data leadership to define career progression pathways. Qualifications - Mastery of data architecture principles and data modelling frameworks. - Strong software engineering mindset with experience in CI/CD for data. - Exceptional communication and stakeholder management skills. - Genuine passion for leadership and mentorship. Requirements - Tech Stack: Dbt, Databricks, Unity Catalog, Terraform, AWS (Redshift, Dynamo db, API gateway, Cloud Watch, Lambda, Streaming with Kinesis/Firehose, Glue, Bedrock). - Languages required: advanced SQL, Python. Benefits - Flexible remote-first work policy with a work-from-home stipend. - Employee Share Ownership Plan (ESOP). - Paid parental leave. - Group Salary Continuance Insurance. - Employee Assistance Program. - Additional leave days including study assistance, celebration days, and volunteering. - Global working groups focused on collaboration, belonging, and connection. - Annual Hackathons. - Novated leasing for electric vehicles, internet reimbursement, and more.

• Work on Data Engineering projects for Vermont state government • Develop and optimize ETL pipelines • Handle SQL queries for data extraction and transformation • Collaborate with team members and stakeholders to ensure data quality and integrity • Produce technical documentation for data processes • Participate in data migration and validation efforts

• Define and maintain JOMIS data architecture standards, including data domains, naming conventions, and logical data models • Document end-to-end data flows, including sources, transformations, storage, and downstream use • Design and guide data integration approaches that support operational medicine workflows and reporting needs • Establish and maintain data governance practices focused on quality, consistency, and traceability • Ensure proper handling of sensitive data, including PHI and PII, in coordination with cybersecurity and compliance teams • Define data structures and mappings that support interoperability across JOMIS systems and external partners • Support analytics and reporting use cases by ensuring data is structured, complete, and reliable • Enable future advanced analytics and AI use cases by improving data readiness and availability • Create and maintain architecture artifacts such as data flow diagrams, logical data models, and dependency maps • Partner with product owners, engineers, and other vendor partners to translate operational needs into clear data requirements • Capture and track data integration efforts in Jira across as identified across multiple products