Job Closed
This listing is no longer active.
Quality-based recruiting partner that specializes in executive level search, recruiting, & process improvement
Lead Data Platform Engineer
Location
United States
Posted
5 days ago
Salary
$155K - $165K / year
Seniority
Senior
Job Description
Lead Data Platform Engineer
TRAC Recruiting
• Design, develop, and support scalable data pipelines and cloud-native data architectures. • Build and maintain production-ready applications and data processing frameworks using Python, PySpark, Scala, and related technologies. • Partner with engineering and business stakeholders to deliver analytics-ready datasets and reporting capabilities. • Contribute to technical architecture decisions, platform improvements, and development best practices. • Develop and optimize ETL/ELT workflows and streaming data solutions. • Create and manage data models, reporting structures, and analytics dashboards using AWS-native tools. • Work with relational and NoSQL databases to support high-volume data processing and storage requirements. • Implement cloud infrastructure solutions leveraging AWS services and container orchestration platforms such as Kubernetes or ECS. • Collaborate with operations teams on backup, disaster recovery, data retention, and security strategies. • Participate in code reviews, technical mentorship, and collaborative problem-solving across the engineering organization. • Evaluate and recommend modern technologies and frameworks that improve scalability, efficiency, and reliability.
Job Requirements
- 3+ years of professional experience in software engineering, data engineering, or cloud platform development.
- Strong experience building and maintaining scalable data platforms and distributed processing systems.
- Proficiency in Python, PySpark, Scala, and/or Typescript.
- Hands-on experience developing Spark-based ETL and reporting frameworks using Spark SQL and Spark Streaming.
- Experience with AWS cloud services, including tools such as S3, Redshift, Glue, Athena, EMR, Lambda, Step Functions, EventBridge, and QuickSight.
- Knowledge of modern data storage and serialization formats such as Parquet and Iceberg.
- Experience with relational databases and NoSQL technologies.
- Strong understanding of cloud security concepts, including IAM, KMS, encryption, Secrets Manager, and data access controls.
- Ability to independently troubleshoot technical challenges and deliver scalable solutions with minimal oversight.
- Experience designing cloud-native applications and services in production environments.
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical discipline, or equivalent practical experience.
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
Senior Platform Engineer
Poland and Eastern EuropeXebia is a global tech company with a journey in CEE that started with two Polish companies – PGS Software and GetInData. We are a team of 1,000+ experts delivering top-notch work across cloud, data, and software. We work on impactful projects across various sectors including fintech, e-commerce, aviation, logistics, media, and fashion, helping clients build scalable platforms and cutting-edge applications. Our clients include notable names like McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, and InPost.
Role Description - Designing, building, and operating scalable Kubernetes-based platform infrastructure. - Developing backend platform services and reusable engineering components. - Building and maintaining cloud-native solutions (primarily on AWS). - Creating and evolving Infrastructure as Code solutions using Terraform. - Designing and implementing CI/CD pipelines and deployment automation. - Developing scalable multi-tenant platform capabilities for engineering teams. - Building self-service developer platform features and internal tooling. - Designing and maintaining APIs and platform architecture standards. - Improving platform reliability, observability, and monitoring capabilities. - Collaborating with engineering teams to improve developer experience and platform adoption. - Contributing to platform engineering best practices and technical standards. - Supporting container platform operations and orchestration processes. - Driving automation and operational excellence across the platform ecosystem. Qualifications - 5+ years of experience as a Platform Engineer. - Practical experience using AI-powered assistants (e.g. Claude Code, GitHub Copilot, Cursor) to improve productivity, quality, or decision-making in software delivery. - Strong hands-on experience with Kubernetes, including cluster operations and orchestration concepts. - Strong backend engineering background. - Strong programming skills in TypeScript and/or Go; Python experience is a plus. - Solid experience with cloud platforms, preferably AWS. - Practical experience with Infrastructure as Code tools, preferably Terraform. - Experience with CI/CD pipelines and deployment orchestration. - Experience designing scalable multi-tenant systems. - Strong understanding of API and platform architecture. - Solid Linux and networking fundamentals. - Experience with observability and monitoring solutions. - Experience building reusable self-service platform capabilities for developers. - Good English communication skills (at least B2 level). - Work from the European Union region and a work permit are required. Requirements - Experience applying GenAI in a more structured way within the SDLC, including defined workflows, prompt patterns, or tool integrations embedded into daily work. - Interest in and familiarity with emerging AI-driven practices (e.g. agent-based workflows, automation patterns, AI-augmented development), with a willingness to explore and experiment beyond standard approaches. - Experience with Internal Developer Platforms (IDP). - Experience building Kubernetes operators and controllers. - Experience with Backstage or developer portal tooling. - Experience in container runtime or platform engineering. - Knowledge of event-driven and distributed systems architecture. - Experience with service mesh technologies and OpenTelemetry. Recruitment Process - CV review - HR call - Technical Interview - Client Interview - Decision
Senior Data Platform Engineer
VirtusLabReach peak performance | IT consulting and software engineering backed by our expertise in Dev Experience, ML and Scala
• Design and implement solutions for indexing Atlan metadata assets • Ensure compliance and data governance • Collaborate with DevOps team for production readiness and maintainability
Principal Data Platform Engineer, Databricks
Prominence AdvisorsDo More With Your Data. Make Healthcare Smarter.
• Own the end-to-end architecture and delivery of scalable data solutions, with a strong emphasis on Databricks-based platforms and modern cloud ecosystems • Lead design and implementation of data pipelines, data models, and transformation frameworks that support analytics, reporting, and advanced use cases • Serve as a primary client-facing technical leader, building trusted relationships and guiding stakeholders through complex data challenges and solution decisions • Translate ambiguous business requirements into clear, actionable technical architectures and delivery plans • Establish and enforce best practices across data engineering, including data ingestion (pipeline orchestration, testing, and optimization) and DevOps • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks • Lead and mentor delivery teams, providing technical guidance, code reviews, and hands-on support to ensure successful project outcomes • Collaborate with cross-functional teams including data architects, analysts, and client stakeholders to ensure alignment and value delivery • Identify risks, proactively address challenges, and ensure high-quality, timely delivery across engagements • Contribute to internal capability building, including reusable frameworks, accelerators, and thought leadership • Support business development efforts by shaping technical solutions, contributing to proposals, and participating in client discussions
Role Description - This is a remote position. - Hands-on experience in Automating solutions in Power shell at L3 level - Experience in monitoring, troubleshooting, and executing Azure Runbooks for operational automation - Working knowledge of Microsoft 365 Groups management and support - Strong Experience in M365 License Management - Strong understanding of Agile methodologies, with experience working in Scrum or Kanban environments - Knowledge of Azure monitoring and diagnostics tools (Log Analytics, Application Insights, Alerts) - Good understanding of application security, reliability, and performance optimization in cloud environments - Excellent problem-solving, collaboration, and communication skills - Proficiency in DevOps practices, including CI/CD pipeline implementation and maintenance (Azure DevOps or GitHub Actions) - AZ-204 - Good understanding of M365 Security and Compliance features, including retention, audit, and data governance policies Qualifications - Required Technical Skill Set: MS Azure, M365, PowerShell Requirements - MS Azure - M365 - PowerShell


