YLD logo
YLD

Creating digital capabilities for you, that last beyond us.

Senior Data Practice Lead

Data EngineerData EngineerFull TimeRemoteLeadTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United Kingdom

Posted

10 days ago

Salary

0

Seniority

Lead

Job Description

Senior Data Practice Lead

YLD

Role Description We're building out data as a first-class practice at YLD, and we need someone in London who can be the credible technical voice in front of clients and prospects, not just describing what we could do, but backing it with real delivery experience. This is a senior role, reporting to our Head of Engineering. You'll sit alongside our commercial and client services leadership in meetings where technical credibility matters, help shape and win new engagements, and stay close enough to client work to guide it and step in yourself when an engagement needs you. Alongside, we expect you to build our external reputation in data through events, writing, and the wider community. Responsibilities - Hands-on delivery (core, from day one): - Doing hands-on data engineering work directly, pipelines, transformation layers, models, and the infrastructure around them, not just guiding others - Adapting to different client contexts: legacy warehouse migrations, greenfield lakehouses, transformation layers that need rescuing - Guiding the wider team and unblocking hard technical problems as your remit grows beyond your own delivery - Defining and evolving our internal standards for data work: testing, documentation, project structure, code review - Mentoring and growing data engineers across the company - Client and commercial (core, from day one): - Joining client and prospect meetings as the technical authority on data, alongside our client services and commercial leads - Shaping proposals and pitches, translating client problems into a credible data approach and a defensible scope - Acting as the escalation point on live data engagements when technical judgement calls need weight behind them - Travelling to client sites for workshops, discovery sessions, and in-person relationship building, and representing YLD at external data events - Practice, talent, and external profile (growth, over the first year): - Owning the growth of YLD's data practice: capability, reputation, and headcount over time - Contributing to attracting and hiring strong data engineers into YLD - Representing YLD at data events and in the wider community as your standing in the market builds - Supporting our sales team so that data becomes something we can proactively sell, not just respond to Qualifications - Consulting or agency experience is a strong plus, but real client or stakeholder-facing exposure elsewhere is acceptable - A track record of technical leadership: leading a team or function - Comfortable presenting to senior client stakeholders and holding your own under commercial pressure - Cross-functional fluency: you translate engineering constraints into business terms and negotiate realistic commitments - Appetite to build a public presence in the data community over time, even if you don't have one yet Requirements - Not theoretical, evidenced by things you've actually shipped, and deep enough to set the bar for a team and answer a sceptical client: - SQL as engineering: read and review SQL that performs at scale, and understand query planning, engine quirks, and how materialisation choices affect cost and performance well enough to guide a team's decisions - Python for data: built and maintained production data systems in typed, testable Python, not just notebooks, and can set that standard for others - Data modelling: made deliberate choices between dimensional, Data Vault, normalised and denormalised designs, and can explain the trade-offs in flexibility, query performance, and maintainability to both engineers and clients - Transformation architecture: design transformations that are idempotent, incremental, and dependency-aware. You think in DAGs, not scripts - Pipeline design: weigh batch, streaming, and micro-batch trade-offs against latency, complexity, cost, and reprocessability, and pick the right approach for the problem - Data testing: know what to catch at build time (schema contracts, assertions, transformation logic) versus defer to observability, and can make that call for a team - Data observability: treat data reliability like site reliability, with measurable indicators, alerting, incident response, and root cause analysis - CI/CD for data: version, test, and deploy pipelines like software, with environment promotion, rollback strategies, and infrastructure as code - Data governance: implemented lineage, cataloguing, sensitive data classification, or access control, and can hold a client to account on making data auditable and secure - Cost-conscious: optimised warehouse spend, storage strategies, or job efficiency, and treat compute as a resource to manage, not ignore - Platform fluency: worked across orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark) - AI Native: experienced in agentic coding workflows (context, harness, loop, and graph engineering), and able to embed AI Engineering constructs into pipelines (RAG, semantic search, evals, guardrails, etc) Benefits - Company Private Health care (currently provided by Vitality) - Enhanced fully paid maternity and paternity leave for up to 6 months - Company's Pension Scheme - 25 days annual holiday (excluding Public Holidays) - £2000 annual allowance for Training/Conferences - £300 annual allowance for additional hardware - Mental Health support - Bonus (depending on Company performance and results) - Company laptop - Generous referral schemes

Related Categories

Related Job Pages

More Data Engineer Jobs

Tripadvisor logo

Data Engineer II

Tripadvisor

Tripadvisor, founded in 2000, is an award-winning network for travel information that features real advice from global travelers. The world’s largest travel s

Data Engineer10 days ago

Title: Data Engineer II (Data Platform) Location: Oxford, Oxfordshire, United Kingdom (Hybrid or Remote) Job Description: The Tripadvisor Group connects people to experiences worth sharing, and aims to be the world’s most trusted source for travel and experiences. We leverage our brands, technology, and capabilities to connect our global audience with partners through rich content, travel guidance, and two-sided marketplaces for experiences, accommodations, restaurants, and other travel categories. The subsidiaries of Tripadvisor, Inc. (Nasdaq: TRIP), include a portfolio of travel brands and businesses, including Tripadvisor, Viator, and TheFork. About the Data Platform Team Our Data Platform team is the engineering backbone of Tripadvisor’s data ecosystem. Formed from the core fundamentals of our Data Engineering and Software Engineering (Data Platform) groups, this unified team combines deep data pipeline expertise with robust platform engineering capabilities. We are responsible for providing software and infrastructure that enable Tripadvisor to better understand visitor preferences, power experimentation across all surfaces (website, mobile app, and customer communications), and drive GenAI, Analytical, and DSML initiatives at petabyte scale. Our team builds and maintains: - Streaming and batch data platforms that unlock data across Tripadvisor - ETL pipelines and data models serving terabytes and growing datasets in Snowflake, BigQuery, and Hive - Orchestration, scheduling, and ETL generation tools to support cloud migrations and petabyte-scale operations - Tracking instrumentation, information architecture, and data governance tooling for business-critical analytics - We collaborate closely with Product, Analytics, Data Science, CRM, Marketing, Finance, and Machine Learning teams across Tripadvisor’s global engineering organization. Tripadvisor is looking for a Data Engineer II to join our fast-moving Data Platform group. In this role, you will design, build, and sustain the data infrastructure that powers the world’s most trusted travel platform. You’ll bring both strong software engineering fundamentals and hands-on data engineering expertise — writing production-quality Java and Python, architecting reliable pipelines, and delivering end-to-end solutions that scale to hundreds of millions of travelers. Do you enjoy building features end-to-end? Do you thrive working with a broad technology stack, releasing frequently, and collaborating with talented engineers worldwide? If so, we’d love to talk. What You’ll Do Data Engineering & Data Products, ETLs - Design, build, and maintain robust ETL/ELT data pipelines that process terabyte-scale data across Snowflake, BigQuery, Hive, and other platforms. - Develop scalable, reusable data models and curated data sets for analytics, data science, CRM, machine learning, and other data consumers across the organization. - Own the full lifecycle of data pipelines: define SLAs, implement performance measurements, monitoring, and anomaly detection. - Ensure enterprise data integrity, validation, documentation, and governance. Platform & Software Engineering - Write production Java and Python code across our evolving platform stack — from data ingestion and event processing to REST services and internal tooling. - Build and maintain streaming and batch processing systems (Flink, Spark, Kafka) that power real-time and analytical workloads. - Take responsibility for all aspects of software engineering: design, implementation, QA, and maintenance, with a CI/CD mindset (most engineers release to production every few days). - Operate on and improve cloud infrastructure on AWS, with familiarity with Gradle, Linux, and related tooling. Quality, Collaboration & Ownership - Take on projects with independence and a mandate to leave things better than you found them. - Be integral to code quality on your team through leadership in design and code review. - Collaborate closely with Product, Design, Analytics, and Data Science teams to define specifications and deliver high-quality solutions. - Communicate effectively with both technical and business stakeholders; translate complex data problems into clear solutions. - Work alongside engineering groups located around the world in a fast-paced, dynamic environment. Skills & Experience - 4–5+ years of data engineering or general software development experience in a commercial setting. - Strong hands-on proficiency in both Java and Python for production systems. - Demonstrated experience designing and implementing complex ETL/ELT processes from concept to production. - Proficiency in SQL and data exploration across large, complex datasets. - Experience with big data technologies (Hadoop, Hive, BigQuery, Snowflake) and working with terabyte-scale or larger datasets. - Solid foundation in data structures, algorithms, and object-oriented design. - Professional experience building REST services and working with event queue systems. - Familiarity with Linux and cloud infrastructure design on AWS or equivalent cloud providers. - Systems performance and tuning experience, with an understanding of how architecture impacts scalability. - Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience. - Strong analytical skills; desire to write clean, correct, and efficient code. - Self-paced, organized, and detail-oriented with a strong sense of ownership, urgency, and pride in your work. - Ability to break down complex problems into simple, pragmatic solutions. - Strong interpersonal skills, intense curiosity, and enthusiasm for solving difficult problems. - Willingness and ability to take on new technologies as our stack evolves. Nice to Have - Experience with stream processing frameworks such as Flink or Spark Streaming. - Experience with task orchestration tools such as Apache Airflow or similar systems. - Familiarity with additional technologies: GraphQL, React, HTML5, JavaScript, CSS, Postgres, Gradle, BERT. - Experience working with and designing infrastructures for large-scale data processing (Hive, Snowflake, NoSQL databases). - Experience with data governance practices and tooling. - Exposure to and/or interest in machine learning, data science, or GenAI to help solve engineering challenges innovatively. - Experience developing scalable code for high-volume, low-latency systems What We Offer - Competitive compensation packages, including base salary, annual bonus, and more. - “Work your way” with flexibility to suit your lifestyle. We take a remote-friendly approach to collaboration, with the option to join on-site as often as you’d like in select locations. - Flexible schedule. Work-life balance is ingrained in our culture by design. Trust and accountability make it work. - Donation matching. Give back? Give more! We match qualifying charitable donations annually. - Tuition assistance. Want to level up your career? We love to hear it! Receive annual support for qualified programs. - Lifestyle benefit. An annual benefit to spend on yourself. Use it on travel, wellness, or whatever suits you. - Travel perks. We believe that travel is employee development, so we provide discounts and more. - Employee assistance program. We’re here for you with resources and programs to help you through life’s challenges. - Health benefits. We offer great coverage and competitive premiums. - Generous referral scheme. Help us grow and be rewarded with generous awards for referring successful candidates. Our Cultural Pillars: - Traveller first: We exist to create value for our customer, the traveler. We enable our suppliers and partners to unlock this value. Their collective behaviors and insights are what drives us. - Execution is our edge: We act fast, experiment, learn from failure, iterate, and improve the solutions of tomorrow across every aspect of our business. Our execution is agile, data-driven, prioritised, and built to scale. We assume no problem is someone else’s problem and finish what can be done today, knowing tomorrow will bring fresh challenges. - We succeed together: The best outcomes are driven by empathic, humble, and diverse subject matter experts working toward shared goals. We collaborate relentlessly, challenge assumptions, give actionable feedback, and set each other up for success through empowered teams with a clear charter. We transparently take ownership of our growth, individually and as a team. We celebrate the quality of our effort, our learnings, and our collective achievements. Discover more in our Tech Blog, for an inside look into some of our exciting and ground-breaking technical projects here at Tripadvisor Group. Tripadvisor Group champions the unique identities, abilities, and experiences of all our people – employees, customers, and partners. This stems from our belief in the transformative power of travel, dining, and experiences to connect us and open doors to worlds very different from our own. Our ED&I strategy shapes how we approach our people, culture, business, and reputation. Tripadvisor Group strives to embed inclusion and belonging across all our brands. We strive to create an accessible and inclusive experience for all candidates. If you need a reasonable accommodation during the application or the recruiting process, please make sure to reach out to your individual recruiter or our team at AccessibleRecruiting@tripadvisor.com. If you have any additional questions about careers at Tripadvisor you can email us at recruitment@tripadvisor.com. We have all the answers! #LI-SM1 #LI-Remote

United Kingdom
Opplane Portugal Unipessoal Lda logo

Senior Data Engineer

Opplane Portugal Unipessoal Lda

Opplane specializes in providing advanced data-focused solutions for financial services, telecommunication, and reg-tech to accelerate their digital transformation journey. Opplane leadership team is comprised of Silicon Valley serial entrepreneurs and experienced executives. Its expertise comes from years of specific industry experience at some of the world’s top companies, such as PayPal, Xerox Parc, Amazon, Wells Fargo, SoFi in the areas of product management, data technology, data governance, data privacy, security, machine learning, and risk management. Global & Multicultural – Diverse perspectives, global collaboration (US, Portugal, India and Singapore offices) Startup Energy – Fast-moving, impact-driven environment Ownership Mindset – Engineers own what they build Collaborative & Friendly – Open, curious, and supportive culture

Data Engineer10 days ago

Role Description We are looking for a Senior Data Engineer with minimum 5+ years of professional experience to design, build, and maintain scalable, high-performance data platforms that power our analytics and machine learning initiatives. You will work in a distributed, data-intensive environment and collaborate with cross-functional teams to ensure data accuracy, reliability, and security. - Design, develop, and maintain scalable data processing pipelines and workflows using frameworks such as Apache Spark, PySpark, and Apache Beam. - Build and maintain microservices in Python that serve data-driven features in production. - Develop internal tools to support CI/CD pipelines, experiment tracking, and data versioning. - Collect, process, and integrate large datasets from multiple sources, including databases, file systems, and APIs. - Ensure data integrity, consistency, and quality through robust validation and monitoring processes. - Optimize data systems for performance, scalability, and high availability. - Implement best practices for data security, access control, and privacy. - Collaborate with data scientists, analysts, and engineers to support analytics and ML workflows. - Lead complex migration initiatives involving the transition from on-premise Cloudera (HDFS, Hive, Impala, HBase) environments to cloud-native platforms (Snowflake or Databricks), ensuring zero data loss and minimal downtime. - Architect and build a large-scale, greenfield data platform from the ground up, including the setup of end-to-end infrastructure, data ingestion layers, transformation frameworks, and high-throughput integrations with Snowflake or Databricks. Qualifications - Strong understanding of distributed systems and modern data architectures. - Proven, hands-on experience with large-scale data platform migrations, specifically transitioning from Cloudera (CDH/HDP) to either Snowflake or Databricks. - Deep technical expertise in building and orchestrating a high-performance data platform from scratch, including the implementation of complex integrations (Reverse ETL, CDC, API ingestions) specifically targeting Snowflake or Databricks. - 5+ years of professional experience in software engineering or data engineering. - Strong software engineering skills with Python in large-scale, high-performance production environments. - Hands-on experience with Spark/PySpark and other big data frameworks. Company Description Opplane specializes in providing advanced data-focused solutions for financial services, telecommunication, and reg-tech to accelerate their digital transformation journey. Opplane leadership team is comprised of Silicon Valley serial entrepreneurs and experienced executives. Its expertise comes from years of specific industry experience at some of the world’s top companies, such as PayPal, Xerox Parc, Amazon, Wells Fargo, SoFi in the areas of product management, data technology, data governance, data privacy, security, machine learning, and risk management. - Global & Multicultural – Diverse perspectives, global collaboration (US, Portugal, India and Singapore offices) - Startup Energy – Fast-moving, impact-driven environment - Ownership Mindset – Engineers own what they build - Collaborative & Friendly – Open, curious, and supportive culture

United States
Job Closed
accantec group logo

Senior Data Engineer

accantec group

Alles aus einer Hand: Wir sind Ihr Komplettanbieter für Business Intelligence, Data Analytics und Data Science.

Data Engineer10 days ago
Full TimeRemoteTeam 51-200Since 2002H1B No Sponsor

Role Description Gestalte als Senior Data Engineer (w/m/d) mit uns die technologische Zukunft von accantec! Als treibende Kraft hinter modernen Datenplattformen auf Basis des Lakehouse-Ansatzes entwickelst Du robuste, skalierbare Datenpipelines, modellierst komplexe Datenstrukturen und lieferst performante, saubere Datenlösungen, die unseren Kunden echten Mehrwert bringen. Werde Teil unseres Expertenteams unbefristet und in Vollzeit an unseren Standorten Berlin, Köln, Hamburg oder remote. - Architektur und Entwicklung skalierbarer ETL-/ELT-Prozesse und Datenpipelines auf Databricks in der Azure Cloud - Datenmodellierung und Aufbau von Lakehouse-Architekturen (z. B. Delta Lake, Medaillon-Modell, Dimensional Modeling) - Automatisierung und Optimierung von Datenflüssen für Performance, Qualität und Stabilität - Integration und Transformation von Daten aus unterschiedlichsten Quellen in Data Warehouses oder Lakehouse-Umgebungen - Implementierung von Best Practices in den Bereichen Data Governance, Monitoring und Security - Mentoring jüngerer Kolleg:innen und aktive Mitgestaltung unserer technischen Standards - Enge Zusammenarbeit mit Data Scientists, Analyst:innen und Consultants, um datengetriebene Lösungen umzusetzen Qualifications - Abgeschlossenes Studium in (Wirtschafts-)Informatik, Data Science oder einem verwandten Bereich - Mehrjährige Projekterfahrung im Aufbau und Betrieb moderner Datenplattformen - Tiefes technisches Know-how in Databricks, Azure Synapse, Azure Data Factory, Python (pandas, PySpark) und SQL - Fundierte Kenntnisse in der Datenmodellierung (z. B. Star Schema, Data Vault, Lakehouse) - Versiert in ETL-/ELT-Prozessen, Performance-Tuning und Workflow-Orchestrierung - Sicherer Umgang mit Cloud-Umgebungen, idealerweise Microsoft Azure - Kenntnisse in Microsoft Fabric, Apache Kafka oder Apache Airflow sind von Vorteil - Verständnis für Data Governance, Security und Compliance - Databricks-Zertifizierungen (z. B. Certified Data Engineer Associate oder Professional) sind ein Plus - Analytisches Denken, Kommunikationsstärke und Freude an Teamarbeit - Deutschkenntnisse in Wort und Schrift und gute Englischkenntnisse Benefits - Werde Teil unseres hochmotivierten Teams aus erfahrenen Data Experts. - Arbeite an innovativen Projekten mit modernen Datenarchitekturen und Cloud-Technologien. - Entwickle dich individuell weiter durch Trainings, Zertifizierungen und unsere accantec-Laufbahnplanung, inklusiver Möglichkeit der technologieübergreifenden Weiterentwicklung im Expertenteam. - Wir bieten flexible Arbeitszeiten beim Kunden vor Ort, in einer unserer zentral gelegenen Niederlassungen oder remote. - Individuelle Sabbaticalvereinbarungen sind möglich. - Erlebe regelmäßige Firmen- und Teamevents wie Weihnachtsfeier, Sommerevent und accantec days. - Nutze tolle Vergünstigungen auf unseren Mitarbeitervorteilsportalen. - Bleib fit und gesund - wir kümmern uns mit Angeboten zur Gesundheitsförderung um Dich. - Profitiere von unserem vergünstigten, deutschlandweiten Sportangebot mit EGYM. - Jubiläumszahlungen und ein Präsent – es lohnt sich! - Sei mobil und flexibel mit Firmenkreditkarte, JobRad, BahnCard50 und der Bezuschussung des Jobtickets. - An Heiligabend und Silvester ist bei uns frei.

Germany
Nearform logo

Senior Data Engineer

Nearform

Building enduring impact

Data Engineer10 days ago
ContractRemoteTeam 201-500H1B No Sponsor

Role Description As a Senior Data Engineer at Nearform your main task will be designing, building, and maintaining scalable data platforms, pipelines, and warehouses using SQL, Python, Spark, Databricks and other relevant technologies. You will play a key role in building efficient data solutions, optimizing performance, and ensuring seamless data integration. However as you’ll likely work on a variety of projects your responsibilities may also include: - Designing, building, and optimizing data pipelines and ETL processes for large-scale data ingestion and transformation. - Developing and maintaining data platforms and warehousing solutions to support analytics and business intelligence needs. - Implementing scalable data storage solutions and ensuring high availability and performance. - Enhancing performance in data processing workflows for maximum speed and scalability. - Collaborating with data scientists, analysts, and stakeholders to understand business needs and translate them into data engineering solutions. - Ensuring data quality, governance, and compliance across all systems. - Supporting CI/CD processes for data pipeline deployments and implementing best practices in DevOps for data workflows. - Conducting code reviews and enforcing best practices in version control, automation, and testing. - Assisting with defining structured source code management and deployment processes. - Working with and supporting Technical Leaders in project execution and timely delivery. - Collaborating with client teams. Qualifications - Significant experience delivering at a Senior Engineer level, specialising in Data engineering. Our Seniors typically have at least 6 years’ commercial experience. - Experience with Python, Data Processing / Relational Database Design, AWS (ECS, Aurora, ElastiCache), Terraform/Terragrunt fundamentals. - Practical experience of delivering in an agile environment. - Practical experience and knowledge of developing real-world solutions. - Experience building software collaboratively using pull requests and code reviews. - Familiarity with data governance, security, and compliance best practices. - Excellent communication and collaboration skills. Benefits - Work remotely; we have a genuine dedication to work/life balance. - Work flexibly; we appreciate there are more important things in life than work so our flexible working culture allows you to work around what matters - school run, no problem! - The Wellness Hub: We have a genuine commitment to fostering/improving NearFormers’ wellbeing; we offer resources and support, including a NearForm advice line which offers confidential support for anything from relationship issues to staying healthy. - Contract Rate up to €450 per day.

Poland
€450 / day