The experience innovation company.
Lead Data Engineer – Platform
Location
Poland
Posted
16 days ago
Salary
0
Seniority
Senior
Job Description
Lead Data Engineer – Platform
Valtech
• Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity • Define and enforce engineering standards for testing, code quality, deployment and documentation • Identify and eliminate manual or repetitive processes through automation and tooling improvements • Integrate AI-assisted development tools into engineering workflows to improve productivity • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale) • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents • Support onboarding and enablement of engineering teams adopting platform tooling • Act as the main technical point of contact for platform and framework-related queries • Partner with engineering teams to identify pain points and translate them into platform improvements • Ensure platform tooling meets security, compliance and operational requirements • Conduct and support code and design reviews across platform components • Monitor platform health, performance and adoption, iterating based on feedback and metrics • Contribute to documentation, developer guides and enablement materials to improve usability and adoption
Job Requirements
- Strong proficiency in Python for building frameworks, automation tooling and reusable components
- Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog)
- Strong SQL skills and experience with distributed processing frameworks such as Apache Spark
- Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale
- Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI)
- Experience with data engineering platform design, including scalable pipeline and workflow architectures
- Strong understanding of software engineering principles (DRY, SOLID, modular design)
- Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform)
- Experience implementing automated testing strategies (unit, integration, data quality)
- Strong understanding of platform monitoring, logging and alerting practices
- Experience writing technical documentation and developer-facing guidance
- Experience working in complex engineering environments with multiple teams
Benefits
- 24 working days of paid vacation
- National holidays covered
- Sick leave (up to 20/year)
- Unpaid leave (up to 20/year)
- Medical insurance
- Multisport card OR Multikafeteria
- Maternity & paternity leave support
- Internal workshops & learning initiatives
- Professional certifications reimbursement
- Participation in professional local & global communities
- Growth Framework to manage expectations and define the steps to move towards the selected career
- Mentoring program with the ability to become a mentor or a mentee to grow to a higher position
- Flexibility, with remote and hybrid work options (country-dependent)
- Career advancement, with international mobility and professional development programs
- Learning and development, with access to cutting-edge tools, training and industry experts
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer I
ProvidenceProvidence Shared Services is a service line within Providence that provides a variety of functional and system support services for our family of organizations across Alaska, California, Montana, New Mexico, Oregon, Texas, and Washington. We are focused on supporting our Mission by delivering a robust foundation of services and sharing of specialized expertise. Providence is proud to be an Equal Opportunity Employer. We are committed to the principle that every workforce member has the right to work in surroundings that are free from all forms of unlawful discrimination and harassment.
• Designs and builds modern data-centric software applications to support clinical and operational processes • Builds data pipelines and transformations, data enrichment processes, provisioning layers, and user interfaces • Works closely with the Product, Platform, and Architecture teams to deliver on joint efforts
Forward-Deployed Engineer – Data Engineering Expert
ViaductMachine learning platform to empower OEMs and their partners to make vehicles safer, more reliable, and personalized.
• Operate as the data engineering expert on the Internal Efficiencies team, collaborating closely with other engineers, data scientists, solution / product experts, and customer success leaders to deliver against user / customer deliverables • Contribute to defining data engineering deliverables from inception to completion, ensuring timely delivery and high-quality outputs • Leverage agentic AI tools on a daily basis to deliver code and improve your productivity • Develop and maintain strong relationships with all Internal Efficiencies team members as well as engineering subject-matter experts across Viaduct • Work with customer success and solution / product team members to scope user/customer needs and translate them into actionable analytics solutions • Deliver against deliverables with quality and speed, contributing new features to solutions and products, refactoring code, improving tests, automating manual processes, and owning other engineering tasks • Stay updated with the latest trends and related technologies and apply them to improve our software
• Designing and implementing data architectures • Data modeling • Collaboration with Data Engineers and Data Analysts
• Partner with Finance leadership across Accounting, Customer Revenue Operations, and Business Finance to architect the migration and integration of systems into Oracle Cloud. • Design and deploy AI/ML solutions to automate and optimize core business workflows, turning enterprise data into operational intelligence. • Lead Data Quality initiatives to establish and enforce a "single source of truth." • Understand business processes to lead the building and maintaining of an enterprise data catalog and empower self-service analytics. • Act as the primary go-to expert and technical consultant for process changes and technical roadmaps within Finance systems.
