Delivering Trusted Environments
Lead Data Engineer
Location
United Kingdom
Posted
5 days ago
Salary
0
Seniority
Senior
Job Description
Lead Data Engineer
Aker Systems
• Lead the design, development and deployment of secure, scalable data pipelines and data platform components. • Design and implement batch and real-time streaming solutions using modern event-driven architectures. • Own technical design decisions across projects, balancing scalability, security, performance and delivery requirements. • Lead technical workshops, discovery sessions and architecture discussions with client stakeholders. • Assess existing client data platforms and design practical approaches for modernisation, migration and integration. • Build and maintain data ingestion, transformation and integration capabilities across a variety of data sources. • Develop cloud-native data platforms using AWS services and open-source technologies. • Ensure data quality, governance, lineage and security requirements are embedded throughout the data lifecycle. • Drive engineering best practices including code reviews, automated testing, CI/CD and Infrastructure as Code. • Support multiple client engagements, helping delivery teams maintain consistent engineering quality and standards. • Mentor and support engineers across project teams, providing technical guidance and leadership. • Perform data modelling, performance tuning and root cause analysis to resolve complex data and platform issues.
Job Requirements
- Strong commercial experience designing and implementing real-time streaming data platforms.
- Hands-on experience with technologies such as Apache Kafka, AWS Kinesis, Apache Flink, Spark Streaming, Apache Pulsar, or similar event-driven technologies.
- Experience building high-volume, low-latency, resilient data pipelines in production environments.
- Strong understanding of modern data engineering patterns, including batch, streaming and hybrid architectures.
- Extensive experience developing and operating enterprise-scale data platforms.
- Strong SQL skills and experience designing data models for analytical and operational workloads.
- Proficiency in Python or other modern programming languages used for data engineering.
- Experience configuring, tuning and optimising relational and NoSQL databases.
- Strong experience working with AWS cloud services, including EC2, RDS, Lambda, Athena, Glue, S3 and IAM.
- Experience working within Agile delivery environments.
- Strong understanding of Test-Driven Development (TDD) and automated testing practices.
- Experience implementing CI/CD pipelines and engineering automation.
- Strong understanding of Infrastructure as Code principles.
- Experience using version control systems such as Git.
- Experience delivering technology solutions within UK Public Sector, Utilities, Energy, Water, Financial Services or other highly regulated industries.
- Understanding of security, governance and compliance considerations within regulated environments.
- Experience with Terraform.
- Experience with Docker and Kubernetes.
- Knowledge of Ansible and Packer.
- Linux and Windows administration experience.
- Experience supporting AI, machine learning or advanced analytics platforms.
- Experience working on programmes requiring UK Government security clearance.
- Strong technical leadership and problem-solving skills.
- Ability to communicate effectively with both technical and non-technical stakeholders.
- Experience working in complex, regulated environments.
- A collaborative approach and willingness to support and mentor others.
- A focus on delivering practical solutions that create value for clients.
- A passion for building reliable, scalable and secure data platforms.
Benefits
- 25 days holiday plus bank holidays
- company paid medical insurance
- life assurance
- pension scheme
- annual training allowance
- wellbeing allowance
- virtual GP
- Employee Assistance plan
- more.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Role Description We're partnering with a growing organisation looking to expand its data team with the addition of a Data Engineer. This is an opportunity to work on a range of data projects, helping to build and optimise modern data solutions that support reporting, analytics, and business decision-making. You'll work closely with both technical and non-technical stakeholders, contributing to the development of scalable data platforms and pipelines while supporting the ongoing evolution of the organisation's data capabilities. - Develop and maintain data pipelines and integration solutions - Support the design and enhancement of cloud-based data platforms - Work with stakeholders to understand and deliver data requirements - Improve data quality, reliability, and performance - Contribute to data architecture and best practice initiatives - Support the delivery of data-driven projects across the business Qualifications - Experience working as a Data Engineer or in a similar data-focused role - Strong SQL and Python skills - Experience building and maintaining data pipelines - Exposure to cloud technologies such as AWS, Azure, or GCP - Understanding of data warehousing - Strong problem-solving and stakeholder engagement skills - Commercial experience working with modern data platforms Benefits - Fully remote working - Competitive salary and benefits package - Exposure to modern technologies and data projects - Flexible working - Opportunities for professional development and progression Company Description
Data Engineer
HRBairesWe are a continuous multifactor authentication company that monitors biometric behavior to provide zero-interruption MFA. Our team consists of PhD machine learning experts and experienced professionals in enterprise applications and cybersecurity. We use passive biometrics and machine learning to automate user identity Our mission is to fundamentally change secure human-computer interaction We launched with the United States Department of Defense as our first customer We are a young, hungry, and well-funded company, offering a unique opportunity to join a driven engineering team
Role Description We are looking for a Data Engineer to join our team. This role is fully remote and offers a direct long-term contract. - Location: Remote - Contract Type: Direct Contract - Long term - Payment: USD 5000 Qualifications - Strong experience with Python - Strong Software Engineering fundamentals like SOLID principles - Experience with containerized deployments in cloud environments (Docker, Kubernetes, EKS, etc.) - Experience working with varied data types and building robust data pipelines (nice to have) - Team player with a collaborative mindset - Comfortable in a dynamic startup environment - Experience in building and maintaining data infrastructure and pipelines in production - Growth mindset focused on continuous learning - Excited to learn about Machine Learning (nice to have) Requirements - Enjoy working on a team where code and software engineering processes are communal property - Dedicated to finding the right way to build software and continually improve - Excited about learning new things every day Benefits - Flexible work - work from home or use the Brooklyn office at your convenience - Project day - One day per month spent on whatever you think is important - Fitness stipend, commuter benefits - Business English language courses for employees in Argentina - Travel to team events and in-person all-hands - Technical books, VPN Access, high-end work computer, etc. Company Description We are a continuous multifactor authentication company that monitors biometric behavior to provide zero-interruption MFA. Our team consists of PhD machine learning experts and experienced professionals in enterprise applications and cybersecurity. - We use passive biometrics and machine learning to automate user identity - Our mission is to fundamentally change secure human-computer interaction - We launched with the United States Department of Defense as our first customer - We are a young, hungry, and well-funded company, offering a unique opportunity to join a driven engineering team
Data Engineer
tbi bankOne of SEE's most profitable and efficient banks on its path to becoming the next generation digital lender.
• Design, develop, and manage scalable data warehouse and data lake systems, both on-premises and in the cloud • Implement and maintain data modeling frameworks using UML and other design tools • Build and maintain ETL/ELT data pipelines to integrate diverse data sources • Ensure real-time and batch data ingestion, transformation, and loading • Ensure data accessibility, performance, and usability by optimizing query performance and addressing latency issues • Build and optimize data validation processes and analytical tools to support data-driven decision-making • Develop data governance methodologies, including data glossary, security protocols, and access management • Ensure compliance with internal and external data standards and regulations • Collaborate with cross-functional teams (data science, business intelligence, product management) to understand business needs and translate them into technical specifications • Provide technical guidance and mentorship to junior data engineers • Design and implement monitoring and alerting systems to ensure data quality, system stability, and optimal performance • Proactively address technical challenges and system limitations to prevent downtime
Senior Data Engineer
Team VelocityTeam Velocity is a SaaS technology provider serving the automotive industry. We provide an omni-channel marketing automation platform and retailing solutions to OEMs and dealerships nationwide. We are revolutionizing the automotive industry with cutting-edge technology to help dealers sell and service more cars. Made by dealers for dealers, Team Velocity’s proprietary technology platform Apollo analyzes consumer behavior to predict who will buy, what they will buy, and when they are ready to service. Apollo automates the entire communication process by delivering hyper-personalized campaigns across every touchpoint, maximizing ROI, and lifetime revenue. Our vision is to serve our clients with a single technology platform that empowers them to execute intelligent marketing across every online and offline channel. We aim to deliver a frictionless consumer experience, from the initial engagement to a final transaction. Our team members are hard-working and driven to achieve success for our clients, and our unique culture promotes creativity, camaraderie, and success.
Role Description We are seeking a Senior Data Engineer to design, develop, and scale the data platform that powers analytics, business intelligence, machine learning, and customer-facing products across our organization. This role will focus on building reliable, high-performance data pipelines and modern data architectures that enable trusted, accessible, and actionable data. The ideal candidate combines strong software engineering skills with deep expertise in cloud data platforms and distributed data processing. This individual will partner with Product, Engineering, Business Intelligence, Data Science, and business stakeholders to deliver scalable data solutions that support operational, analytical, and AI-driven initiatives. - Design, build, and maintain scalable data pipelines and ELT/ETL workflows. - Develop and optimize data models and enterprise data structures that support reporting, analytics, machine learning, and operational applications. - Leverage Snowflake and modern cloud data platforms to ingest, transform, and optimize large datasets. - Partner with Business Intelligence and Data Science teams to deliver trusted, production-ready datasets. - Design and implement data quality, validation, and monitoring processes. - Support both batch and near real-time data integration requirements. - Develop APIs and data services that enable internal and customer-facing applications. - Optimize data pipeline performance, scalability, and cost efficiency. - Document data architectures, pipeline processes, and engineering standards. - Evaluate emerging technologies and recommend improvements to the organization's data platform. - Mentor team members and help establish engineering best practices. Qualifications - 7+ years of experience in Data Engineering, Software Engineering, or a related field. - Strong SQL skills and extensive experience working with modern cloud data platforms, preferably Snowflake. - Strong proficiency with Python and data engineering development practices. - Experience designing and maintaining large-scale ELT/ETL pipelines. - Strong understanding of data modeling, data warehousing, and distributed data architectures. - Experience integrating structured and semi-structured data from multiple internal and external sources. - Familiarity with data orchestration and transformation frameworks. - Strong troubleshooting and performance optimization skills. - Excellent communication and stakeholder management skills. - Ability to work independently while managing multiple initiatives. Preferred Qualifications - Automotive industry data experience, including vehicle, dealership, CRM, inventory, consumer, telematics, finance, aftermarket, or mobility datasets. - Experience with dbt and modern analytics engineering workflows. - Experience with streaming technologies and event-driven architectures. - Experience supporting Business Intelligence, Data Science, and AI initiatives. - Familiarity with machine learning data pipelines and feature engineering concepts. - Experience working in a remote-first environment. Requirements - Compensation commensurate on experience. - Participation in company benefit offerings include medical, dental, vision, unlimited paid leave, 401(k) matching, wellness, and more. Next Steps - If you meet the requirements, and are interested in applying for this role, please complete the online application, be sure to include a current resume and contact information. - Local and remote candidates (living within Eastern or Central Time Zone) will be considered. - No relocation assistance provided for this position. - NO PHONE CALLS PLEASE. Company Description Team Velocity is a full-service marketing agency serving the automotive industry, providing integrated marketing solutions to OEMs and dealerships nationwide. We leverage our proprietary Apollo™ technology platform to predict consumer behavior, personalize marketing campaigns, and help dealerships drive more sales and service revenue. Our team members are driven, creative, and collaborative, enjoying a unique culture where innovation and client success are paramount. Join us in revolutionizing automotive marketing and technology through powerful, data-driven insights, continuous improvement, and an unwavering commitment to reliability.

