Platform Engineer
Location
CET (UTC+1)
Posted
7 days ago
Salary
0
Seniority
Mid Level
Job Description
Platform Engineer
Avacone
Role Description We are looking for an experienced Platform Engineer to support, maintain and further develop our Cloudera, Elastic Stack and Dataiku platform environment. The role combines platform operations, solution development, automation and user support. You will work closely with data engineers, data scientists, analysts and business stakeholders to deliver stable, scalable and efficient data and analytics solutions. Key Responsibilities - Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms - Design and develop data pipelines, workflows, dashboards and platform integrations - Build and support real-time streaming solutions using Apache Kafka - Develop custom scripts, plugins and integrations using Python, Scala and REST APIs - Design and automate ETL and data ingestion processes using tools such as Apache NiFi and Logstash - Create Kibana dashboards, reports, queries and search solutions - Support the deployment and operationalisation of machine learning models in Dataiku - Automate platform deployments and operations using Ansible, Terraform or similar tools - Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies - Troubleshoot platform, workflow and integration issues - Create reusable scripts, templates, libraries and technical documentation - Provide guidance, training and platform support to users and internal teams - Support occasional weekend or public holiday activities related to system changes or testing Qualifications - Strong experience with at least two of the following platforms: Cloudera, Elastic Stack, Dataiku DSS - Good knowledge of Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and Kafka - Experience with Elasticsearch, Logstash, Kibana and Beats - Experience designing data pipelines, ETL processes and streaming solutions - Programming or scripting experience with Python and/or Scala - Experience integrating platforms and external systems through REST APIs - Good knowledge of GitHub, branching strategies, pull requests and code reviews - Experience with CI/CD, infrastructure automation and deployment processes - Understanding of clean code, secure coding and documentation standards - Strong troubleshooting, analytical and communication skills - Ability to translate business requirements into practical technical solutions - Professional English skills Preferred Qualifications - Experience with machine learning deployment and data science platforms - Knowledge of Apache NiFi, Terraform, Ansible or Puppet - Experience working in enterprise-scale data and analytics environments - Familiarity with agile and DevOps working practices Expected Outcomes - Stable and well-maintained platform environments - Reliable delivery of data pipelines, dashboards and analytics solutions - Automated and optimised platform operations - Effective user support and knowledge transfer - Clear, reusable and up-to-date technical documentation
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
Senior Software Engineer, Platform Team
The Voleon GroupApplying statistical machine learning to investment management.
• Design and implement distributed scheduling and workflow systems • Improve job prioritization, resource allocation, and orchestration across hybrid environments • Build scalable, reliable platform services and storage abstractions • Lead complex projects from design through production delivery • Improve system reliability, observability, and operational performance • Provide technical leadership and mentorship across the team • Lead complex projects from start to finish, which includes gathering project requirements, translating them into a rational software design, reasoning effectively about supporting or dependent technologies, and communicating effectively with collaborators and teammates • Provide technical guidance to engineering and research staff • Mentor and grow individual contributors to continuously up-level the team
• Lead a platform engineering team: technical direction, design reviews, code review, and day-to-day delivery. • Set the technical direction for your team’s area of the stack. • Represent platform engineering in roadmap planning: translate product requirements into scoped, sequenced technical work. • Work closely with the bring-up team to surface operational pain points. • Collaborate with the security engineering team to integrate security guidance at the platform layer. • Coordinate with the other platform engineering leads on shared architecture, joint initiatives and cross-team delivery. • Own reliability, observability, security, and interface and versioning standards for the services your team ships. • Stay hands-on: take on complex or high-risk engineering work directly alongside the team. • Run post-mortems and close structural gaps after incidents. • Manage the team: 1:1s, performance conversations, hiring interviews and onboarding.
• Design and implement Kubernetes operators and controllers that manage the lifecycle of compute, storage, and networking resources • Work closely with the product team to understand roadmap requirements and implement the platform capabilities that support them • Collaborate with the bring-up team to identify operational pain points and turn them into scalable platform features • Improve and extend the northbound API layer — the interface between user-facing services and the underlying infrastructure platform • Build and extend confidential computing capabilities across the platform stack — from secure bare metal and confidential VMs to Confidential Containers (CoCo) • Integrate security guidance from the security engineering team into platform-level controls and remediate security findings at the platform layer • Build platform capabilities around networking: reliability, performance, and observability of the overlay and underlay network stack • Contribute to storage platform improvements: provisioning workflows, attachment reliability, performance tuning, and failure handling • Own observability as a platform concern — instrument services, define meaningful metrics, and build tooling that gives the team visibility into platform health • Participate in code review, technical design discussions, and cross-team collaboration in an Agile (Kanban or Scrum) environment
• Own the strategy for Volta’s platform software - the IaaS and bare-metal management stacks, the operational and analytics tooling on the data centre layer, and the build-versus-buy calls as the business scales. • Translate the product roadmap owned by the CPO into a concrete platform engineering roadmap, in strategic alignment with the CTO, and own execution against it. • Make the architectural calls that keep the platform coherent as scope and headcount grow. • Grow the platform engineering organisation from its current size toward 50-plus engineers across the US and EU, deliberately and without lowering the hiring bar. • Build the management and technical-lead layer beneath you, including hiring the Director, Platform Engineering, EMEA as your deputy. • Define team structure, ownership boundaries and the engineering practices that keep a fast-growing, distributed organisation shipping. • Lead architecture and design reviews, drive the hard technical debates, and own the boundary between the platform software and the hardware layers beneath it. • Partner with the CPO and product organisation on platform direction, without that partnership running through a reporting line. • Keep tight, well-defined boundaries with Infrastructure Engineering, Network Engineering and the CDO’s organisation, and embed security with Cyber Security Engineering across the SDLC. • Represent the platform in front of customers and at the executive level inside and outside Volta.

