Machine learning platform to empower OEMs and their partners to make vehicles safer, more reliable, and personalized.
Data Engineer
Location
Slovenia
Posted
6 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
Viaduct
• Creating and supporting batch, incremental, and real-time ETL pipelines • Standardizing ingestion, validation, and cleaning processes across clients • Automating data validation to increase data quality • Managing and evolving schemas in all parts of our pipeline • Monitoring, tuning, and optimizing Spark jobs • Becoming a domain-expert in connected vehicle data
Job Requirements
- 3+ years as a data engineer
- Experience as a tech lead or mentor
- Proficiency in Python/Scala/Java/C++ and SQL
- 3+ years of experience with Spark or equivalent technologies
- 2+ years of experience with a workflow scheduler (Airflow, Prefect, Argo, etc)
- 2+ years of experience with distributed file-systems (HDFS, S3, etc)
- Familiar with the tools in open-source data ecosystem (Apache, CNCF, etc)
- Experience with incremental or real-time processing (Delta Lake, Apache Hudi, Kafka Stream, Spark Streaming, etc)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
Definitive Healthcare, USDefinitive Healthcare (NASDAQ: DH) is passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of healthcare. We empower them to uncover the right markets, opportunities, and people—paving the way for smarter decisions and greater impact. Headquartered just outside of Boston, Massachusetts. Operates across North America, Europe, and India. Supports a growing global client base of more than 2,400 customers since our founding in 2011. Earned multiple workplace honors, including Built In’s 100 Best Places to Work in Boston (2024 and 2025), a Stevie Bronze Award for Great Employers, and recognition as a Great Place to Work in India. Fosters a collaborative, inclusive culture where diverse perspectives drive innovation.
Role Description You’ll be joining a team of engineers to work on a broad spectrum of descriptive data sets related to providers across the healthcare continuum. Definitive Healthcare is a rapidly growing and fast-paced company, and it is essential that you are able to successfully manage multiple competing priorities. The ideal candidate for this position will identify problems, analyze information, and formulate creative solutions and processes. As a Senior Data Engineer, the projects that you and your team will tackle on a daily basis are dynamic and innovative by nature. You must be comfortable speaking up, sharing ideas, and driving change. What You’ll Do - Managing data coming from various sources and integrating data into our product utilizing expertise in SQL, Python, AWS Argo and/or Airflow workflows. - Integrating new data assets into our product and re-engineering existing data flows for optimal performance utilizing SQL, Python, and AWS workflows. - Adding value to our product through creativity and ability to explore innovative solutions pertaining to optimizing and operationalizing the ways in which we currently collect and transform data and regarding how to best incorporate new and evolving data sets based in your SQL and ETL expertise and familiarity with automation tools. - Working collaboratively with other engineers on large scale projects and serve as a mentor for junior engineers, helping them hone their technical acumen relating to SQL, Python and AWS. - Working closely with Product Management and Product Engineering teams on the development and engineering of our product and the complex data and data structures it contains. Additionally, partnering with teams to support the continuous evolution and growth of our product and its intricacy. Qualifications - 5+ years of professional experience, ideally in a data engineering role - Intermediate to advanced SQL proficiency - Experience using Python or a similar language - Experience using ETL tools. Preferably AWS Argo and/or Airflow. Nice to have SSIS. - Experience with data engineering, preferred within healthcare - Understand data modelling concepts - Familiar with code repos such as GitHub and/or Azure - Experience with database systems such as SQL Server and Postgres - Familiar with AWS S3 storage and Databricks unified data platform - Leverage AI tools to help facilitate code development - Desire to take on more responsibility and ownership of your work - Excellent analytical skills, including working with large data sets Benefits - The salary range for this position is $106,000 – $198,000 per year, which represents the base pay the company reasonably and in good faith expects to pay for this role. Actual pay within this range will be determined based on factors such as relevant experience, skills, and qualifications. - Depending on the position, employees may also be eligible to participate in a company bonus or commission plan. - All employees are eligible for a comprehensive benefits package, including medical, dental, and vision coverage. - Unlimited paid time off. - Participation in the company’s 401(k) plan with employer contribution. Company Description Definitive Healthcare (NASDAQ: DH) is passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of healthcare. We empower them to uncover the right markets, opportunities, and people—paving the way for smarter decisions and greater impact. - Headquartered just outside of Boston, Massachusetts. - Operates across North America, Europe, and India. - Supports a growing global client base of more than 2,400 customers since our founding in 2011. - Earned multiple workplace honors, including Built In’s 100 Best Places to Work in Boston (2024 and 2025), a Stevie Bronze Award for Great Employers, and recognition as a Great Place to Work in India. - Fosters a collaborative, inclusive culture where diverse perspectives drive innovation.
Data Specialist in Track Geometry
CentioCentios övergripande mål är att vara ett konsultbolag som erbjuder smarta och hållbara lösningar som utvecklar samhället på ett positivt sätt. Läs gärna mer om oss på centio.se.
Role Description Vi söker en Dataspecialist inom specialiststöd spårgeometri till Trafikverket. Detta är ett konsultuppdrag med möjlighet att arbeta på distans från hela Sverige. Uppdraget omfattar 60 % av en heltid. Uppdraget innebär ett nära samarbete med kunden vilket ställer stora krav på flexibilitet och samarbetsförmåga. Dataspecialisten arbetar med ajourhållning och specialiststöd inom spårgeometri samt stödjer verksamheten inom järnvägsdata, leverans av förvaltningsdata och kvalitetssäkring av levererad information. Rollen omfattar även arbete med import och export av spårgeometri samt utredning av kvalitetsbrister. Qualifications - Minst 4 års erfarenhet av verksamhet för spårprojektering - Mycket god IT-vana inom järnvägsområdet - Goda kunskaper inom järnvägsdataområdet - Flytande svenska i tal och skrift Requirements - Specialiststöd vid ajourhållning av spårgeometri - Specialiststöd till investeringsverksamhet vid leverans av förvaltningsdata - Importarbeten, d.v.s. koppla ihop ny levererad spårgeometri med befintlig spårgeometri i databasen - Exportarbeten, d.v.s. leverera ut beställda geometrier till projekt och underhållsarbeten - Mottagningskontrollera levererad data - Utreda befintliga kvalitetsbrister Benefits - Villkor anpassade för individen, inklusive arbetstider och arbetsomfattning - Kompetensutveckling anpassad utifrån medarbetarens behov - Arbete i små grupper för att bidra med och ta del av erfarenheter - Fokus på välmående och balans mellan arbete och fritid - Nollvision mot stress och prioritering av trivsel och hälsa
Senior Data Engineer – Snowflake, Amazon QuickSight
3Pillar GlobalBuilding digital businesses, together.
• Design, develop, and optimize scalable **ETL/ELT pipelines** for enterprise data platforms • Build and maintain robust data solutions using **Snowflake, Python, and AWS services** • Develop advanced SQL queries using **CTEs, window functions, query tuning, and performance optimization techniques** • Work with **Snowflake warehouses, tasks, streams, and data pipelines** for efficient data processing • Create and maintain data transformation workflows using **dbt (data build tool)** • Develop reporting datasets and support dashboarding solutions using **Amazon QuickSight** • Perform **data validation, data integrity checks, and root cause analysis** to ensure data accuracy and reliability • Integrate and manage data across platforms including **DynamoDB, S3, AWS Glue, Lambda, and Rockset** • Collaborate with cross-functional teams including analytics, product, and clinical stakeholders to support reporting requirements • Monitor pipeline performance and troubleshoot production data issues
• Architecture & Solution Design • Own full lifecycle delivery: requirements → design → build → deploy → adoption → optimization & support • Ensure performance, scalability, and reliability across EDW and BI platforms • Drive cloud deployment and production readiness of analytics solutions • Facilitate architecture and technical design sessions • Act as a trusted advisor bridging business strategy and technical delivery • Lead and mentor BI developers, data engineers, and analysts • Establish and enforce data governance, data stewardship, security, and reporting standards


