From cloud optimisation and application modernisation to connectivity and collaboration, we are Nasstar.
Principal Data Engineer
Location
United Kingdom
Posted
32 days ago
Salary
£100K - £130K / year
Seniority
Lead
Job Description
Principal Data Engineer
Nasstar
• Serve as the bridge between complex technical architecture and strategic business value. • Act as the primary strategic partner to client business owners, aligning technical data solutions with corporate goals while championing reliability and "clean data" for all consumers. • Drive the development of complex, large-scale data architectures and multi-year technology roadmaps. • Oversee "team-of-teams" delivery performance, ensuring the quality and resilience of high-impact data pipelines. • Lead the triage and resolution of critical platform incidents, maintaining transparent communication with clients. • Implement robust governance frameworks and compliance controls. • Champion an organisational culture of knowledge sharing and represent the firm at industry events. • Influence long-term organizational health by driving platform efficiency and leading strategic hiring and retention initiatives.
Job Requirements
- Proven experience in a principal engineering role.
- Extensive experience with cloud data platforms such as Azure or AWS, with a focus on Databricks.
- Highly skilled with Pythonic data processing tools such as Pyspark and SparkSQL.
- Strong understanding of data modelling concepts relational and non-relational databases.
- Proficiency in SQL and experience with data integration and ETL tools.
- Excellent knowledge of big data technologies and frameworks.
- Strong knowledge of data governance and data security best practices.
- Strong analytical mindset with attention to detail and a consultative approach.
- Excellent communication and stakeholder management skills.
Benefits
- Remote-first working with flexibility around client needs.
- Private health insurance.
- Projects with global brands & public sector leaders, working on real-world impact.
- Exclusive access to AWS & Databricks certifications, training, and partner tools.
- A collaborative culture of technical excellence and continuous learning.
- A lead role in shaping delivery standards and future Data & Consulting practices within the firm.
- Competitive salary, bonus structure, and long-term growth opportunities.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Title: Data Team Leader Location: United Kingdom Employees can work remotely Full-time Job Description: Please note this role has the flexibility to be hybrid working or fully remote based on your location. Working within the Healthcare (registries) division of NEC Software Solutions you will oversee a team of data scientists and data analysts (DSA) who’s duties feature a mix of maintaining existing applications, regular and bespoke report generation, dashboard creation, documenting code bases, cleansing datasets, identifying data quality issues in large databases and support the analytical requirements of clinical steering committees. Your primary responsibilities will be to manage the workload of the team, identify opportunities for team members to upskill, coordinate/standardise the production of reports, contribute to the statistical oversight and data efficacy boards, explore new opportunities for the application of machine learning and advanced statistical methodologies to health data and support the development of the DSA team. The focus of your work will be on data that is held in clinical registries relating to various performance outcomes for patients who have undergone surgical or medical interventions. This role involves working closely with the data science and analytics team, as well as clinicians, to develop new registries and health data reporting procedures to support the work of the NHS and private UK healthcare providers. This role has the flexibility to be hybrid working or fully remote based on your location and may require occasional trips to the head office in Hemel Hempstead or other NEC/NHSE locations in the UK to facilitate in-person meetings. Key responsibilities include: - Oversee a team of data scientists and data analysts - Prioritise and schedule the competing workloads of the team to meet delivery timelines - Lead regular update and 1-to-1 meetings with team members - Liaise with industry and academic partners to align and improve our statistical methodology and reporting strategy - Identify and provide appropriate training opportunities for members of the data science and analytics team - Explore real-world-evidence data sets for registry-specific analytical opportunities - Coordinate and assist with the generation of regularly scheduled and bespoke reports, including the plotting of charts using standard libraries - Take charge of data cleansing, quality assurance and supporting integration. - Contribute ideas to improve productivity and delivery. - Liaise with members of the data quality, development, business analyst and business consultant teams to deliver collaborative outputs - Build an extensive clinical knowledge base through meeting regularly with clinical steering committees - Work closely with clinicians to understand and support their reporting and analytical needs Qualifications Mandatory qualifications and experience: - A postgraduate degree in computer science, statistics, biology or a related quantitative discipline. - Expert R (R Studio) programming skills for manipulation/cleaning, report generation, visualisation of data, statistical analysis and modelling - Experience leading a team of data scientists or analysts - Proficiency with SQL (Azure) for data manipulation, extract creation and aggregation of data from disparate sources - Proven experience cleansing, processing and managing large data sets - Proven experience responding creatively to analytical briefs - Experience with data warehouses and open database connectivity - Statistical expertise (including survival analysis and predictive modelling) - The ability to deliver under pressure and without regular supervision - Proven problem-solving skills and ability to work to deadlines - Self-motivation and a flexible approach to work - The ability to thrive in a collaborative team environment - Desirable qualifications and experience: - Experience working with health data including clinical data registries - Experience working with ‘unclean’ data and free text - An interest in the application of machine learning, NLP and AI to solve problems related to health data and patient safety - Experience using Snowflake/DBT - Prompt Engineering for Github Copilot or equivalent Additional Information We pride ourselves in offering an excellent benefits package, including an above average pension scheme. When you join the team at NEC Software Solutions, you are provided with the following: - Private Medical Cover funded by NEC for Employees (with the option to add family members at an additional cost) - 25 days paid holiday with the option to buy/sell - 4 x basic salary life assurance cover funded by NEC (with the option to increase cover at an additional cost) - A Group Pension Plan with fantastic employer contributions up to a maximum of 8.5% - A selection of flexible benefits to suit your individual needs Candidates must be able to demonstrate a pre-existing right to work and travel within the UK. Documentary evidence will be required. All offers are subject to satisfactory vetting and reference checks. Depending on the nature of the role a Disclosure Barring Service (DBS) check may also be required. NEC Software Solutions is an equal opportunities employer, welcoming applications from all communities. If you require any reasonable adjustments or have specific accessibility needs during the recruitment or interview process, please feel free to share these with us. We are committed to ensuring an inclusive and accommodating experience for all candidates. Candidates must be able to demonstrate a pre-existing right to work and travel within the UK. Documentary evidence will be required. All offers are subject to satisfactory vetting and reference checks. This role will require UK Security Clearance. NEC Software Solutions is an equal opportunities employer, welcoming applications from all communities. If you require any reasonable adjustments or have specific accessibility needs during the recruitment or interview process, please feel free to share these with us. We are committed to ensuring an inclusive and accommodating experience for all candidates. Who We Are: We’re NEC Software Solutions (part of global tech giant NEC Corporation). While you read this ad, our software is helping to dispatch ambulances, support families, keep trains on the move, locate missing people and even test the hearing of newborn babies. Working with us, you’ll be helping our 3,000+ employees push the boundaries of what’s possible and support amazing public services. We work with governments, hospitals, police forces, housing providers, local authorities and more. We help them pay financial support faster, speed up treatments for patients and respond to emergencies in the right way. The more we do, the more our customers can do for others. And together, we make a world of difference. We’d love your help. And we’ll support you all the way. NEC’s Healthcare division specialises in medical registries and health screening. The company’s software has been used to screen millions of babies for hearing loss and other inherited conditions. It also supports national and local diabetic eye screening programmes. NEC is the largest clinical registry supplier in the UK and its customers include NHS England’s UK-wide Outcomes and Registries Programme (which will become one of the largest clinical registries in the world), as well as specialist registries such as for robotic and spinal surgery.
Role Description Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable and efficient data solutions in the cloud. - Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. - Gather and analyze data requirements from business stakeholders and identify opportunities for data-driven insights. - Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. - Ensure data quality, integrity, and security throughout all stages of the data lifecycle. - Collaborate with cross-functional teams to design and implement data models, schemas, and storage solutions. - Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features. - Provide technical guidance and expertise to junior data engineers and developers. - Stay up-to-date with emerging trends and technologies in cloud computing, big data, and data engineering. - Contribute to the continuous improvement of data engineering processes, tools, and best practices. Qualifications - Bachelor's or Master's degree in computer science, engineering, or a related field. - 10+ years of experience as a Data Engineer, Software Engineer, or similar role, with a focus on building cloud-based data solutions. - Strong experience with cloud platforms such as Azure. - Proficiency in Apache Spark and Databricks for large-scale data processing and analytics. - Experience in designing and implementing data processing pipelines using Spark and Databricks. - Strong knowledge of SQL and experience with relational and NoSQL databases. - Experience with data integration and ETL processes using tools like Apache Airflow or cloud-native orchestration services. - Good understanding of data modeling and schema design principles. - Experience with data governance and compliance frameworks. - Excellent problem-solving and troubleshooting skills. - Strong communication and collaboration skills to work effectively in a cross-functional team. - Relevant certifications in cloud platforms, Spark, or Databricks are a plus.
Senior Platform Engineer Data AI
MetLifeMetLife is a leading insurance and financial services company based in New York, New York. The company and its affiliates specialize in employee benefits and li
Title: Senior Platform Engineer Data AI Location: Cary, NC, United States Alternative Location(s) Cary, North Carolina Working Schedule Full-Time Work Arrangement Hybrid Travel Required 10% Relocation Assistance Available No Job ID 16822 Job Description: The Opportunity The Lead Architect is responsible for driving technology lifecycle modernization through DevOps, data, and AI-enabled solutions across the enterprise. Guided by our purpose—always with you, building a more confident future—and MetLife’s New Frontier strategy, this role plays a critical part in ensuring platforms remain current, secure, scalable, and aligned with risk and lifecycle standards. This is an exciting opportunity to lead high-impact initiatives that modernize application platforms through automation, standardized tooling, and intelligent capabilities. You’ll partner closely with engineering, architecture, and platform leaders to influence how modern DevOps and AI-driven approaches are adopted at scale, improving operational stability and long-term sustainability across MetLife. Key Responsibilities - Lead enterprise DevOps and platform modernization initiatives that improve technology currency, reliability, and scalability. - Create automated CI/CD pipelines, infrastructure-as-code solutions, and AI-enabled capabilities to support application teams. - Oversee integration of secure, compliant, and observable solutions across development and production environments. - Develop standards, patterns, and best practices while providing technical guidance to engineering teams. - Collaborate with architecture, engineering, and platform stakeholders to ensure consistent adoption of modern technologies. Required Qualifications - Bachelor’s degree in computer science, Engineering, or related discipline, or equivalent practical experience. - 5 + years of experience in DevOps, platform engineering, software engineering, or related roles. - Demonstrated experience working with database technologies (relational and/or NoSQL). - Experience supporting or developing AI. This can include AI‑enabled agents, intelligent automation, or AI‑driven systems. - Strong understanding of operating systems, networking, and security fundamentals. Preferred Qualifications - Hands‑on experience in custom software development within a cloud‑based DevOps environment, including familiarity with CI/CD automation. - Experience implementing data quality checks, validation frameworks, lineage, and governance controls in regulated environments. - Hands‑on experience designing and operating data solutions on cloud platforms (preferably Azure), including storage, compute, and networking fundamentals. - Familiarity with Enterprise Risk Management, Compliance, Internal Audit, or other GRC domains. - Experience within Financial Services or a global insurance organization. Location Expectation: This is a hybrid role requiring a minimum of 3 days per week in office. The expected salary range for this position is $105,400 - $150,000. This role may also be eligible for annual short-term incentive compensation. All incentives and benefits are subject to the applicable plan terms. Benefits We Offer Our U.S. benefits address holistic well-being with programs for physical and mental health, financial wellness, and support for families. We offer a comprehensive health plan that includes medical/prescription drug and vision, dental insurance, and no-cost short- and long-term disability. We also provide company-paid life insurance and legal services, a retirement pension funded entirely by MetLife and 401(k) with employer matching, group discounts on voluntary insurance products including auto and home, pet, critical illness, hospital indemnity, and accident insurance, as well as Employee Assistance Program (EAP) and digital mental health programs, parental leave, paid time off, paid holidays, volunteer time off, tuition assistance and much more! About MetLife Recognized on Fortune magazine's list of the "World's Most Admired Companies", Fortune World’s 25 Best Workplaces™, as well as the Fortune 100 Best Companies to Work For®, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East. Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we’re inspired to transform the next century in financial services. At MetLife, it’s #AllTogetherPossible. Join us! MetLife is an Equal Opportunity Employer. All employment decisions are made without regards to race, color, national origin, religion, creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, age, disability, marital or domestic/civil partnership status, genetic information, citizenship status (although applicants and employees must be legally authorized to work in the United States), uniformed service member or veteran status, or any other characteristic protected by applicable federal, state, or local law (“protected characteristics”).
Data Engineer
Irth SolutionsThe Most Complete SaaS Platform for Damage Prevention, Asset Protection and Risk Management
Role Description Irth is developing a unified Databricks-based Lakehouse platform to consolidate and govern data across multiple cloud environments and products. As a Data Engineer, you will play a hands-on role in implementing scalable data pipelines, applying governance and quality standards, and supporting the enterprise data architecture. You will work closely with the Senior Data Architect to build reliable, secure, and high-performance data pipelines using Databricks, Spark, and cloud-native technologies. This role is ideal for mid-level engineers looking to expand their expertise in Databricks, Spark, Delta Lake, and modern lakehouse architecture. Data Pipeline Development - Build and maintain ingestion pipelines across AWS, Azure, and GCP. - Implement batch and streaming pipelines using Databricks, Spark/PySpark, SQL, Delta Live Tables, and Lakeflow. - Apply medallion architecture patterns for structured data transformation. - Implement CDC, SCD Type 1/2, schema evolution, and data validation. Platform & Storage Implementation - Manage Delta Lake storage, tables, partitions, and performance optimization (OPTIMIZE, Z-ORDER, VACUUM). - Support metadata management, lineage tracking, and cataloging using Unity Catalog. - Assist with multi-cloud integrations between cloud storage platforms and Databricks. Governance, Quality & Compliance - Implement data quality validation, profiling, and monitoring aligned with governance standards. - Apply security controls including RBAC, encryption, and data classification. - Support metadata and lineage implementation using Unity Catalog, Purview, or similar tools. Orchestration, Automation & Operations - Build and manage workflows using Databricks Workflows, Delta Live Tables, Azure Data Factory, or similar tools. - Support CI/CD pipelines, code versioning, and deployment automation. - Assist in troubleshooting, pipeline recovery, and performance tuning. Collaboration & Documentation - Work closely with the Senior Data Architect to implement architecture designs. - Participate in design reviews and technical discussions. - Document pipelines, data models, transformation logic, and operational procedures. Qualifications - 3–5 years of experience in data engineering, ETL, or cloud data platforms. - Experience with Databricks, Spark, PySpark, or distributed data processing. - Strong SQL and structured data transformation skills. - Experience with at least one cloud platform (Azure preferred; AWS/GCP acceptable). - Knowledge of data modeling, schema evolution, pipeline troubleshooting, and data quality. - Understanding of security practices including RBAC, encryption, and credential management. Preferred - Experience with Delta Lake, medallion architecture, and lakehouse design. - Familiarity with Unity Catalog, Purview, Glue Catalog, or similar tools. - Experience with orchestration tools (ADF, Airflow, Databricks Workflows). - Experience with Git, CI/CD, and DevOps practices. - Knowledge of Power BI, geospatial data, or AI/ML data preparation. - Relevant cloud or Databricks certifications (DP-203, Data Engineer Associate, etc.). Education - Bachelor’s or master’s degree in computer science, Software Engineering, or a related field, or equivalent professional experience. Benefits - Being an integral part of a dynamic, growing company that is well respected in its industry. - Competitive pay based on experience.



