Job Closed
This listing is no longer active.
A pioneer in the fields of digital and technology, Valtech is a global business-transformation agency that was founded in 1993 to deliver "innovation with a pur
Lead Data Engineer – Platform
Location
Poland
Posted
65 days ago
Salary
0
Seniority
Senior
Job Description
Lead Data Engineer – Platform
Valtech
• Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity • Define and enforce engineering standards for testing, code quality, deployment and documentation • Identify and eliminate manual or repetitive processes through automation and tooling improvements • Integrate AI-assisted development tools into engineering workflows to improve productivity • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale) • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents • Support onboarding and enablement of engineering teams adopting platform tooling • Act as the main technical point of contact for platform and framework-related queries • Partner with engineering teams to identify pain points and translate them into platform improvements • Ensure platform tooling meets security, compliance and operational requirements • Conduct and support code and design reviews across platform components • Monitor platform health, performance and adoption, iterating based on feedback and metrics • Contribute to documentation, developer guides and enablement materials to improve usability and adoption
Job Requirements
- Strong proficiency in Python for building frameworks, automation tooling and reusable components
- Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog)
- Strong SQL skills and experience with distributed processing frameworks such as Apache Spark
- Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale
- Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI)
- Experience with data engineering platform design, including scalable pipeline and workflow architectures
- Strong understanding of software engineering principles (DRY, SOLID, modular design)
- Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform)
- Experience implementing automated testing strategies (unit, integration, data quality)
- Strong understanding of platform monitoring, logging and alerting practices
- Experience writing technical documentation and developer-facing guidance
- Experience working in complex engineering environments with multiple teams
Benefits
- 24 working days of paid vacation
- National holidays covered
- Sick leave (up to 20/year)
- Unpaid leave (up to 20/year)
- Medical insurance
- Multisport card OR Multikafeteria
- Maternity & paternity leave support
- Internal workshops & learning initiatives
- Professional certifications reimbursement
- Participation in professional local & global communities
- Growth Framework to manage expectations and define the steps to move towards the selected career
- Mentoring program with the ability to become a mentor or a mentee to grow to a higher position
- Flexibility, with remote and hybrid work options (country-dependent)
- Career advancement, with international mobility and professional development programs
- Learning and development, with access to cutting-edge tools, training and industry experts
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Designs and builds modern data-centric software applications to support clinical and operational processes • Builds data pipelines and transformations, data enrichment processes, provisioning layers, and user interfaces • Works closely with the Product, Platform, and Architecture teams to deliver on joint efforts
Forward-Deployed Engineer – Data Engineering Expert
ViaductMachine learning platform to empower OEMs and their partners to make vehicles safer, more reliable, and personalized.
• Operate as the data engineering expert on the Internal Efficiencies team, collaborating closely with other engineers, data scientists, solution / product experts, and customer success leaders to deliver against user / customer deliverables • Contribute to defining data engineering deliverables from inception to completion, ensuring timely delivery and high-quality outputs • Leverage agentic AI tools on a daily basis to deliver code and improve your productivity • Develop and maintain strong relationships with all Internal Efficiencies team members as well as engineering subject-matter experts across Viaduct • Work with customer success and solution / product team members to scope user/customer needs and translate them into actionable analytics solutions • Deliver against deliverables with quality and speed, contributing new features to solutions and products, refactoring code, improving tests, automating manual processes, and owning other engineering tasks • Stay updated with the latest trends and related technologies and apply them to improve our software
• Designing and implementing data architectures • Data modeling • Collaboration with Data Engineers and Data Analysts
Senior Data Engineer
DistantJobRemote Recruitment Agency®. Find your next superstar remote developer in under 3 weeks.
• Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling. • Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets. • Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE. • Use PowerShell, SQL Server tools, and scripting to automate processes. • Enhance functionalities by integrating with APIs and external systems. • Address problems comprehensively, focusing on end-to-end solutions beyond the database layer. • Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks. • Explore and implement LLM-driven workflows, including prompting and structured outputs. • Continuously enhance efficiency by replacing manual processes with automation.
