Job Closed

This listing is no longer active.

TRAC Recruiting logo
TRAC Recruiting

Quality-based recruiting partner that specializes in executive level search, recruiting, & process improvement

Lead Data Platform Engineer

Platform EngineerPlatform EngineerFull TimeRemoteSeniorTeam 11-50Since 2007H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

5 days ago

Salary

$155K - $165K / year

Seniority

Senior

Job Description

Lead Data Platform Engineer

TRAC Recruiting

• Design, develop, and support scalable data pipelines and cloud-native data architectures. • Build and maintain production-ready applications and data processing frameworks using Python, PySpark, Scala, and related technologies. • Partner with engineering and business stakeholders to deliver analytics-ready datasets and reporting capabilities. • Contribute to technical architecture decisions, platform improvements, and development best practices. • Develop and optimize ETL/ELT workflows and streaming data solutions. • Create and manage data models, reporting structures, and analytics dashboards using AWS-native tools. • Work with relational and NoSQL databases to support high-volume data processing and storage requirements. • Implement cloud infrastructure solutions leveraging AWS services and container orchestration platforms such as Kubernetes or ECS. • Collaborate with operations teams on backup, disaster recovery, data retention, and security strategies. • Participate in code reviews, technical mentorship, and collaborative problem-solving across the engineering organization. • Evaluate and recommend modern technologies and frameworks that improve scalability, efficiency, and reliability.

Job Requirements

  • 3+ years of professional experience in software engineering, data engineering, or cloud platform development.
  • Strong experience building and maintaining scalable data platforms and distributed processing systems.
  • Proficiency in Python, PySpark, Scala, and/or Typescript.
  • Hands-on experience developing Spark-based ETL and reporting frameworks using Spark SQL and Spark Streaming.
  • Experience with AWS cloud services, including tools such as S3, Redshift, Glue, Athena, EMR, Lambda, Step Functions, EventBridge, and QuickSight.
  • Knowledge of modern data storage and serialization formats such as Parquet and Iceberg.
  • Experience with relational databases and NoSQL technologies.
  • Strong understanding of cloud security concepts, including IAM, KMS, encryption, Secrets Manager, and data access controls.
  • Ability to independently troubleshoot technical challenges and deliver scalable solutions with minimal oversight.
  • Experience designing cloud-native applications and services in production environments.
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical discipline, or equivalent practical experience.

Related Categories

Related Job Pages

More Platform Engineer Jobs

Poland and Eastern Europe logo

Senior Platform Engineer

Poland and Eastern Europe

Xebia is a global tech company with a journey in CEE that started with two Polish companies – PGS Software and GetInData. We are a team of 1,000+ experts delivering top-notch work across cloud, data, and software. We work on impactful projects across various sectors including fintech, e-commerce, aviation, logistics, media, and fashion, helping clients build scalable platforms and cutting-edge applications. Our clients include notable names like McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, and InPost.

Full TimeRemoteTeam 1,001-5,000

Role Description - Designing, building, and operating scalable Kubernetes-based platform infrastructure. - Developing backend platform services and reusable engineering components. - Building and maintaining cloud-native solutions (primarily on AWS). - Creating and evolving Infrastructure as Code solutions using Terraform. - Designing and implementing CI/CD pipelines and deployment automation. - Developing scalable multi-tenant platform capabilities for engineering teams. - Building self-service developer platform features and internal tooling. - Designing and maintaining APIs and platform architecture standards. - Improving platform reliability, observability, and monitoring capabilities. - Collaborating with engineering teams to improve developer experience and platform adoption. - Contributing to platform engineering best practices and technical standards. - Supporting container platform operations and orchestration processes. - Driving automation and operational excellence across the platform ecosystem. Qualifications - 5+ years of experience as a Platform Engineer. - Practical experience using AI-powered assistants (e.g. Claude Code, GitHub Copilot, Cursor) to improve productivity, quality, or decision-making in software delivery. - Strong hands-on experience with Kubernetes, including cluster operations and orchestration concepts. - Strong backend engineering background. - Strong programming skills in TypeScript and/or Go; Python experience is a plus. - Solid experience with cloud platforms, preferably AWS. - Practical experience with Infrastructure as Code tools, preferably Terraform. - Experience with CI/CD pipelines and deployment orchestration. - Experience designing scalable multi-tenant systems. - Strong understanding of API and platform architecture. - Solid Linux and networking fundamentals. - Experience with observability and monitoring solutions. - Experience building reusable self-service platform capabilities for developers. - Good English communication skills (at least B2 level). - Work from the European Union region and a work permit are required. Requirements - Experience applying GenAI in a more structured way within the SDLC, including defined workflows, prompt patterns, or tool integrations embedded into daily work. - Interest in and familiarity with emerging AI-driven practices (e.g. agent-based workflows, automation patterns, AI-augmented development), with a willingness to explore and experiment beyond standard approaches. - Experience with Internal Developer Platforms (IDP). - Experience building Kubernetes operators and controllers. - Experience with Backstage or developer portal tooling. - Experience in container runtime or platform engineering. - Knowledge of event-driven and distributed systems architecture. - Experience with service mesh technologies and OpenTelemetry. Recruitment Process - CV review - HR call - Technical Interview - Client Interview - Decision

Europe
VirtusLab logo

Senior Data Platform Engineer

VirtusLab

Reach peak performance | IT consulting and software engineering backed by our expertise in Dev Experience, ML and Scala

Full TimeRemoteTeam 201-500Since 2010H1B No Sponsor

• Design and implement solutions for indexing Atlan metadata assets • Ensure compliance and data governance • Collaborate with DevOps team for production readiness and maintainability

Poland
Prominence Advisors logo

Principal Data Platform Engineer, Databricks

Prominence Advisors

Do More With Your Data. Make Healthcare Smarter.

Full TimeRemoteTeam 51-200Since 2014H1B No Sponsor

• Own the end-to-end architecture and delivery of scalable data solutions, with a strong emphasis on Databricks-based platforms and modern cloud ecosystems • Lead design and implementation of data pipelines, data models, and transformation frameworks that support analytics, reporting, and advanced use cases • Serve as a primary client-facing technical leader, building trusted relationships and guiding stakeholders through complex data challenges and solution decisions • Translate ambiguous business requirements into clear, actionable technical architectures and delivery plans • Establish and enforce best practices across data engineering, including data ingestion (pipeline orchestration, testing, and optimization) and DevOps • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks • Lead and mentor delivery teams, providing technical guidance, code reviews, and hands-on support to ensure successful project outcomes • Collaborate with cross-functional teams including data architects, analysts, and client stakeholders to ensure alignment and value delivery • Identify risks, proactively address challenges, and ensure high-quality, timely delivery across engagements • Contribute to internal capability building, including reusable frameworks, accelerators, and thought leadership • Support business development efforts by shaping technical solutions, contributing to proposals, and participating in client discussions

United States

Role Description - This is a remote position. - Hands-on experience in Automating solutions in Power shell at L3 level - Experience in monitoring, troubleshooting, and executing Azure Runbooks for operational automation - Working knowledge of Microsoft 365 Groups management and support - Strong Experience in M365 License Management - Strong understanding of Agile methodologies, with experience working in Scrum or Kanban environments - Knowledge of Azure monitoring and diagnostics tools (Log Analytics, Application Insights, Alerts) - Good understanding of application security, reliability, and performance optimization in cloud environments - Excellent problem-solving, collaboration, and communication skills - Proficiency in DevOps practices, including CI/CD pipeline implementation and maintenance (Azure DevOps or GitHub Actions) - AZ-204 - Good understanding of M365 Security and Compliance features, including retention, audit, and data governance policies Qualifications - Required Technical Skill Set: MS Azure, M365, PowerShell Requirements - MS Azure - M365 - PowerShell

Worldwide