Generative media in the blink of an API.
Platform Data Engineer
Location
United Kingdom
Posted
26 days ago
Salary
0
Seniority
Mid Level
Job Description
Platform Data Engineer
Runware
Role Description Runware is building a high-performance AI media-creation platform powering instant generation of text, image, video, 3D, and audio. As our platform scales and integrations grow, we need robust, reliable, and high-throughput data systems. We’re looking for a Data Engineer to architect and maintain our data backbone — with a special focus on high-volume logs, and performance pipelines. Your main mission is to build, optimize, and maintain Runware’s data infrastructure. You will ensure that logs, metrics, performance data, and events are efficiently ingested, processed, stored, and ready to be analyzed by engineering, ML, and product teams. This role is central to: - Supporting observability & platform reliability - Enabling deep log & performance analytics - Powering internal dashboards and customer reporting - Providing clean, structured data to the Data Expert and all stakeholders What You Will Do - Architecture & Ownership - Design, build, and maintain schemas and data models - Optimize table layout, partitioning, indexing, and compression for high-volume data - Ensure fast, efficient querying for logs, requests, metrics, and performance traces - Maintain ingestion pipelines for billions of records - Data Engineering & Pipelines - Build robust pipelines for: - API logs - Model inference logs - Error events - Usage & integration events - GPU & system metrics - Implement ETL/ELT workflows to transform raw data into analytics-ready structures - Ensure quality, reliability, and real-time availability of data sources - Performance & Log Analysis Infrastructure - Build tooling to support large-scale log analysis - Enable deep investigation into latency, throughput, errors, and bottlenecks - Provide the raw data foundation for E2E inference-time monitoring - Help debug production issues using logs and traces - Tooling & Observability Infrastructure - Work closely with DevOps, ML, and backend engineering - Integrate pipelines with monitoring tools (Prometheus, Grafana, Datadog, OpenTelemetry) - Automate ingestion and cleanup tasks - Build internal libraries or utilities to support monitoring and debugging workflows - Collaboration & Cross-Functional Support - Provide clean data interfaces for the Data Expert (dashboards, monitoring, analytics) - Support engineering teams by exposing the right logs and metrics - Contribute to debugging, RCA (root cause analysis), and performance optimization initiatives Qualifications - Solid experience as a Data Engineer or similar role in a production environment - Strong understanding of data pipelines, streaming vs batch processing, and data modeling - Experience working with analytical databases (ClickHouse is a plus, but not mandatory) - Comfortable digging through logs, metrics, and platform data to understand system behavior - Familiarity with event-based systems, monitoring, and observability concepts - Pragmatic mindset: you care about usefulness, reliability, and performance over theory - Comfortable working cross-functionally with backend, infra, and data profiles - Startup / scale-up experience is a plus Nice to Have - Experience with high-throughput or realtime systems - Exposure to cost monitoring, performance analytics, or platform observability - Background in AI, ML platforms, or data-heavy products Benefits - Generous paid time off – vacation, sick days, public holidays - Meaningful stock options – share in the upside you create - Remote-first setup – work from home anywhere we can employ you - Flexible hours – own your schedule outside core collaboration blocks - Family leave – paid maternity, paternity, and caregiver time - Company retreats – twice-yearly gatherings in inspiring locations Company Description We’re a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life. Our release cycles are fast and intense, but they’re followed by real downtime. After big pushes we expect the team to unplug, recharge, and come back ready & stronger than ever for the next leap. Please note: We are unable to offer visa sponsorship in the UK at this time. Candidates must have existing right to work in the UK.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
Benchmark AnalyticsOur mission: Transform police force management through an all-in-one, data management and early intervention system.
• Designing, developing, and maintaining scalable data pipelines and ETL/ELT processes • Contributing to the design and implementation of a greenfield data platform • Operating in a hybrid greenfield and brownfield environment • Leading development discussions and defining engineering patterns and standards • Assessing and analyzing legacy data processes • Collaborating with cross-functional teams • Improving data pipeline performance, observability, and reliability • Supporting documentation efforts for scalability and platform adoption • Providing technical mentorship and guidance to junior engineers • Acting as a technical SME in internal and client-facing discussions
• Design, implement, and operate production data platforms across Azure SQL, on premise SQL Server, Azure Storage, Microsoft Dataverse, and Microsoft Fabric or Power BI. • Build and maintain ingestion pipelines using SFTP file drops, APIs, CDC or SQL Log Shipping patterns, and Azure Data Factory or equivalent orchestration tools. • Design and evolve analytic data models using star, snowflake, Data Vault, or hybrid approaches. • Implement automated data quality checks, validations, and alerts across pipelines and semantic layers. • Implement practical data governance using Microsoft Purview or equivalent tooling. • Partner closely with DevOps to reduce manual processes and increase repeatability.
• Design and develop modern data engineering solutions — including data pipelines, lakehouse architectures, and analytics platforms — for the largest companies and organizations in Nordics. • Design, build, and maintain scalable data integration and transformation pipelines across cloud-native data platforms. • Apply data modeling and governance best practices to ensure reliable, scalable, and business-aligned analytics solutions. • Collaborate with customers and stakeholders to gather and translate requirements into technical solutions. • Optimize pipeline and platform performance to meet scalability and reliability demands. • Contribute to documentation and knowledge sharing within the team. • Work in agile teams, participating in planning, reviews, and continuous improvement. • Stay current with emerging data technologies and bring relevant innovations into your work.
Data Engineer
Moda HealthBased in Portland, Oregon, Moda Health is a health insurance agency offering individual health plans, Medicare Advantage plans, and employee group health coverage to customers in O
Title: Data Engineer Location: USA Job Description: Let’s do great things, together! About Moda Founded in Oregon in 1955, Moda is proud to be a company of real people committed to quality. Today, like then, we’re focused on building a better future for healthcare. That starts by offering outstanding coverage to our members, compassionate support to our community and comprehensive benefits to our employees. It keeps going by connecting with neighbors to create healthy spaces and places, together. Moda values diversity and inclusion in our workplace. We aim to demonstrate our commitment to diversity through all our business practices and invite applications from candidates that share our commitment to this diversity. Our diverse experiences and perspectives help us become a stronger organization. Let’s be better together. Position Summary The Data Engineer role on the Data Science Team (DST) is responsible for designing, maintaining, and enhancing data integration pipelines that support the Enterprise Data Warehouse (EDW) and downstream analytics. This role supports the existing on premises data environment while actively contributing to cloud modernization initiatives, including the adoption of modern data transformation and cloud data warehouse technologies such as dbt and Snowflake. This is a FT WFH position. Pay Range $78,911.43 - $110,265.00 annually (depending on experience). *This role may be classified as hourly (non-exempt) depending on the applicant's location. Actual pay is based on qualifications. Applicants who do not exceed the minimum qualifications will only be eligible for the low end of the pay range. Please fill out an application on our company page, linked below, to be considered for this position. https://j.brt.mv/jb.do?reqGK=27777149&refresh=true Benefits: - Medical, Dental, Vision, Pharmacy, Life, & Disability - 401K- Matching - FSA - Employee Assistance Program - PTO and Company Paid Holidays Required Skills, Experience & Education: - 1 - 5 years of experience working with large datasets in relational databases and SQL-based data analytic platforms. Experience with SQL Server and modern SQL-based cloud data warehouses, e.g. Snowflake, BigQuery, Redshift, etc.) is preferred. - 1 - 5 years of hands-on SQL development experience, including writing complex queries, stored procedures, and performance tuning. - 1 - 5 years of practical experience developing and supporting data pipelines and transformations using SSIS, SQL Agent, Azure Data Factory, and/or Airflow. Exposure to modern cloud-based transformation tools such as dbt or similar is preferred. - Experience supporting on-premises data warehouse environments and contributing to future cloud modernization efforts, including assisting with migrations from on-premises SQL Server–based platforms to Snowflake or similar cloud technologies. - Solid understanding of data management principles, relational data structures, and data modeling, with the ability to apply best practices in both on-premises and modern SQL-based cloud data warehouses. - Demonstrated analytical skills and ability to contribute to data driven solutions that address real business problems, with guidance from senior engineers when needed. - Working knowledge of Agile development methodologies and participation in collaborative, team-based delivery models. - Exposure to DevOps practices using tools such as Azure DevOps (CI/CD, work item tracking, GIT version control, Pull Requests) is desirable. - Experience working with business intelligence and reporting tools such as SAS Enterprise Guide, Power BI or SSRS, including supporting downstream analytics and reporting users. - Familiarity with programming or scripting languages such as Python, R, or Java is a plus. - Experience with healthcare data is strongly preferred. - Bachelor’s degree in a related field or equivalent practical experience preferred. Primary Functions: - Design, develop, test, and maintain ETL/ELT pipelines that ingest data from multiple internal and external source systems into the Enterprise Data Warehouse (EDW). - Automate, maintain and enhance existing data pipelines to ensure reliability, performance, and scalability, while implementing incremental improvements as part of ongoing cloud modernization efforts. - Contribute to data platform modernization initiatives, including assisting with migrations to cloud-based infrastructure and adoption of modern data tools and practices. - Develop, implement, and support data quality checks, validation processes, and monitoring to ensure data accuracy and consistency. - Build and support modern, enterprise-grade data pipelines and models under the guidance of senior engineers to enable adoption of next-generation data architecture. - Collaborate with cross-functional teams to understand data and reporting requirements and provide ongoing support for data infrastructure needs. - Support the Data Science team by implementing and maintaining data solutions that enable advanced analytics and machine learning cases. - Participate collaboratively in Enterprise Data Warehousing, Business Intelligence, and other data management initiatives, including code reviews and documentation. - Perform other duties as assigned. Working Conditions: - Office environment with extensive close PC and keyboard use, constant sitting, and frequent phone communication. Must be able to navigate multiple computer screens. A reliable, high-speed, hard-wired internet connection required to support remote or hybrid work. Must be comfortable being on camera for virtual training and meetings. Work in excess of standard workweek, including evenings and occasional weekends, to meet business need. - Experience in healthcare systems is a plus; Facets experience preferred. Together, we can be more. We can be better. Moda Health seeks to allow equal employment opportunities for all qualified persons without regard to race, religion, color, age, sex, sexual orientation, national origin, marital status, disability, veteran status or any other status protected by law. This is applicable to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absences, compensation, and training. For more information regarding accommodations, please direct your questions




