Upvest logo
Upvest

The Investment API

Senior Data Product Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2017H1B No SponsorCompany SiteLinkedIn

Location

Europe + 2 moreAll locations: Europe | Northern Europe | Western Europe

Posted

31 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Product Engineer

Upvest

Role Description Upvest's data platform powers near real-time financial analytics about operations across trading, payments, risk, and compliance. We're building the next generation of our data infrastructure - an Iceberg-backed Lakehouse and CDC-powered pipelines that give engineers, analysts, and business users a single, reliable place to work with data at scale. You'll own our Kafka consumer and CDC pipelines, help architect and deliver the Lakehouse foundation, and act as a trusted consultant for data integration, modelling, and schema design across the organization. If you care about reliability, scalability, and lowering the barrier to working with data - this is your role. We are open to hire remotely in Europe for this role. What you’ll do: - Own and improve the Kafka consumer pipeline that captures, transforms, and warehouses event data - Design and build CDC-based pipelines to capture and replicate changes from source systems into the data platform - Design, build and maintain foundational data serving layers that scale and serve the use cases of engineering and analytics alike - Act as a data consultant across the organization - advising on data integration, modelling, and schema design for teams building on or contributing to the platform - Deliver self-service data solutions that enable engineers, analysts, and business users to work with the data platform independently - Drive data observability: set up tests, metrics, and alerting for pipeline health and data quality using observability tooling such as Datadog - Work closely with product engineering teams to ensure reliable, timely data availability - Champion data culture - share knowledge, establish best practices, and help teams understand and trust their data Qualifications - Strong experience building and operating event-driven data pipelines, ideally with Kafka or similar streaming infrastructure - Experience with Python, Go or another systems-level language for building data infrastructure - Solid SQL skills for data transformation, modelling, and staging layer development - Familiarity with infrastructure-as-code tooling such as Terraform for managing cloud resources - Experience working with cloud providers such as GCP, AWS, or Azure (we run primarily on GCP) - Experience with schema design and data modelling principles - able to advise teams across the organization - Experience setting up data observability and monitoring (Datadog, Grafana, Prometheus, etc.) - A product and consulting mindset - able to understand the needs of engineers, analysts, and business users and translate them into platform solutions - Strong communication skills and ability to promote data literacy across the organization Requirements - Experience with or strong interest in CDC tooling (Debezium, Fivetran, or similar) - Familiarity with open table formats such as Apache Iceberg, Delta Lake, or Hudi - or strong interest in growing into this space - Experience with building Agentic AI Benefits - Best-in-class AI tools: Every Upvenger has €20,000 per year to spend on the best AI tools available - Impact-driven work: Building the infrastructure that will power the future of investing in Europe - Wellbeing: 30 days of annual leave, sports benefits, and access to professional coaching - Development: Access to a personal development budget - Flexible work environment: Work from any of our hubs in Berlin, London or Tallinn hybrid or remotely across Europe - Compensation and equity: Competitive, above-market salary and participation in our employee equity program - Team celebrations: Participate in company-wide events to connect with colleagues - Inclusion: Commitment to a culture where everyone belongs and thrives Company Description Upvest empowers businesses to offer a wide range of investment products and the best experience in the field of capital market investment and retirement planning. Founded in 2017 by Martin Kassing, Upvest now brings together over 270 talented professionals from more than 70 nationalities. Upvest is backed by €280M in total funding from world-class investors.

Related Categories

Related Job Pages

More Data Engineer Jobs

EY logo

Data Engineering Manager

EY

Building a #BetterWorkingWorld by providing trust through assurance and helping organizations grow, transform & operate.

Data Engineer31 days ago
Full TimeRemoteTeam 10,001+Since 1989H1B Sponsor

• Lead and mentor a team of data engineers • Define and drive the overall data architecture strategy • Oversee the design and implementation of data ingestion frameworks and integration solutions • Develop and manage CI/CD pipelines • Collaborate closely with clients and internal stakeholders • Act as a trusted advisor to clients • Ensure adherence to data governance and security standards • Drive the adoption of DevOps/DataOps principles within the team • Manage project priorities and delivery timelines

India
Job Closed
Full TimeRemoteTeam 501-1,000H1B Sponsor

• Support scalable data operations through development of ETL processes, SQL-based integrations, Power Platform solutions, and Power BI reporting capabilities. • Design, build, maintain, monitor, and troubleshoot data-processing automations. • Develop and maintain data ingestion pipelines from external sources into SQL databases. • Manage automated flows to trigger Logic Apps and handle lightweight processes. • Perform full-stack BI development including data modeling, DAX development, and report publishing. • Leverage Microsoft Fabric as the unified access platform. • Ensure alignment with security and compliance requirements. • Conduct root-cause analysis to reconcile discrepancies between systems.

Washington
$125K - $150K / year
Job Closed
Full TimeRemoteTeam 501-1,000

Role Description We are looking for a Senior Data Engineer to join the Innovation team as a core member of the PF-LLM programme — our initiative to build a from-scratch multivariate time-series foundation model across a fleet of ~1,000 wind and PV sites. You will be the connective tissue of the entire programme: - Owning the data foundation that makes state-of-the-art model training possible. - Managing the inference service that makes model outputs usable. - Overseeing platform integration that puts those outputs in front of pilot customers. - From production ETL through to shadow-mode validation pipelines, you will be the engineer who keeps every track moving. This role is critical-path from day one. Qualifications - 6+ years of back-end and data engineering experience, with a proven track record of shipping production systems. - Production-grade ETL/ELT pipeline design at scale: idempotency, retry logic, backfill jobs, incremental loading, and cost-controlled warehouse compute. - Schema design and data modelling across heterogeneous sources — experience reconciling signals from disparate systems into a canonical, queryable format. - Data quality engineering: automated quality gates (sparsity, flatline detection, outlier flagging, freshness checks), alerting pipelines, and dataset versioning for ML reproducibility. - API design and development: RESTful inference services with contract testing, latency and throughput budgeting, and structured observability (logs, metrics, traces). - Experience integrating ML model outputs into SaaS product surfaces: auth and authorisation, customer isolation, and feature flag management. - Cloud infrastructure proficiency (AWS preferred), containerisation (Docker, Kubernetes), and CI/CD pipeline ownership. - Python and SQL as core tools; hands-on experience with modern warehouse technologies (Snowflake, BigQuery, or Databricks). - Pipeline orchestration with Airflow, Prefect, Dagster, or equivalent. - Excellent written and verbal communication skills in English. Requirements - Design and build the production ETL pipeline from source systems to warehouse and feature store at fleet scale, covering thousands of wind and PV sites across multiple OEMs. - Own canonical signal schema design across wind and PV asset classes and OEMs — the deepest technical unknown in the programme and the foundation everything else depends on. - Implement automated data quality gates: sparsity and missingness checks, flatline detection, outlier flagging, and freshness validation, with alerting that generates tickets automatically. - Implement dataset versioning sufficient to reproduce every trained model from scratch. - Build and maintain backfill jobs, idempotency guarantees, and retry logic that survive mid-run failure without duplicating data. - Govern storage and compute costs on the warehouse from day one. - Build the batch and on-demand inference API with contract tests, sized for fleet-wide daily runs. - Establish latency and throughput baselines; own the cold-start and model-loading strategy. - Instrument the service with structured logs and metrics from the outset. - Integrate forecasts into the Power Factors product platform: auth and authorisation with customer isolation, observability hooked into the existing stack, and feature flags per customer and per site. - Build and maintain the shadow validation pipeline: run live inference in parallel with the existing forecast path, log predictions and actuals, and produce weekly validation reports broken down by asset class, OEM, and region. - Support the pilot customer rollout: enable the product for friendly customers behind flags and own incoming data and integration tickets throughout the pilot window. - Work closely with the ML Engineer to align on data quality requirements, feature store interfaces, and the handoff between the data platform and training pipeline. - Partner with the Tech Lead and Frontend Engineer during platform integration to ensure a clean, maintainable integration surface. - Contribute to architectural decisions across the programme and document data flows, schemas, and pipeline runbooks to a standard that supports the broader team. Benefits - Comprehensive benefits package including health, dental, and vision coverage, plus dedicated wellness support. - Generous paid vacation policy. - Employer RRSP matching program. - Work-from-abroad opportunities with manager approval. - Exposure to a global team operating across multiple countries and time zones. - A humble cause with a clear purpose — you will help us fight climate change with code every day at work.

Worldwide
Truelogic Software logo

Senior Data Engineer – Enterprise B2B Marketplace

Truelogic Software

Premium boutique software development company that helps brands with big ideas to make a difference in people’s lives.

Data Engineer31 days ago
Full TimeRemoteTeam 501-1,000Since 2004H1B No Sponsor

• Data Platform Evolution: Guide the foundational architecture, scaling strategies, and long-term roadmap of the enterprise data platform. • Pipeline Engineering: Design and lead the development of highly scalable data pipelines using Airflow, dbt, and Python. • Modern Stack Integration: Build and maintain high-throughput integrations across core modern data stack tools, including Fivetran, Redshift, and Sigma. • Serverless Architecture: Develop and optimize serverless data services and ingestion layers leveraging AWS infrastructure (e.g., AWS Lambda). • Advanced Data Modeling: Partner with cross-functional stakeholders to define reliable, performant data warehouse architectures and analytical datasets. • Observability & Reliability: Implement automated testing, rigorous monitoring frameworks, and tracing to maximize pipeline reliability and minimize operational downtime. • Technical Leadership & Governance: Mentor data engineers and analysts on engineering best practices, while driving continuous improvements in data governance and documentation.

Mexico