CentraState Healthcare System logo
CentraState Healthcare System

Live Life Well...Love Your Work.

Lead Data Platform Engineer

Platform EngineerPlatform EngineerFull TimeRemoteSeniorTeam 1,001-5,000H1B No SponsorCompany SiteLinkedIn

Location

New Jersey

Posted

2 days ago

Salary

0

Seniority

Senior

Job Description

Lead Data Platform Engineer

CentraState Healthcare System

• Own the technical architecture of the data platform end-to-end: ingestion, storage, transformation, orchestration, serving, and observability layers. • Author and maintain the platform architectural vision document; lead quarterly architecture reviews to assess alignment with organizational goals and technology trends. • Define and evolve the target-state architecture for the platform, establishing a multi-year technology roadmap in partnership with engineering leadership. • Evaluate emerging technologies, frameworks, and make evidence-based adoption recommendations. • Serve as the final technical escalation point for complex design questions, cross-team conflicts, and build-vs-buy decisions affecting the platform. • Lead the planning, execution, and delivery of multi-quarter platform initiatives involving multiple engineers, cross-functional dependencies, and significant organizational impact. • Break down large, ambiguous programs into scoped workstreams; assign technical leads per workstream, define milestones, and manage cross-team dependencies and risk. • Drive initiative kick-offs with clear problem framing, success criteria, architectural constraints, and delivery phasing — from 0-to-1 exploration through production hardening. • Maintain stakeholder alignment throughout delivery: proactively communicate status, surface trade-offs, and escalate blockers to leadership before they become risks. • Lead post-mortems and retrospectives for large initiatives; document and socialize lessons learned to raise the organizational bar on delivery excellence. • Exercise functional oversight across the EDAP team: review technical designs, set quality gates, approve architectural decisions, and ensure consistency of implementation patterns. • Define, document, and socialize platform engineering standards including coding conventions, testing requirements, CI/CD practices, schema design guidelines, and SLA frameworks. • Establish and own the platform's technical review process (design review): triage incoming projects, chair review sessions, and ensure decisions are documented and traceable. • Identify and drive resolution of technical debt, redundancy, and architectural drift that impede platform reliability, developer productivity, or scalability. • Partner with security, compliance, and infrastructure teams to ensure platform systems meet governance, data privacy, and regulatory requirements by design. • Serve as a primary technical mentor for junior and senior data platform engineers across the platform; provide structured coaching on system design, technical communication, and engineering judgment. • Conduct and lead design reviews, architecture critiques, and technical deep-dives that strengthen the overall capability of the engineering team. • Define what technical excellence looks like at each level of engineers and participate in calibration discussions. • Represent the data platform in engineering-wide forums, all-hands, and external venues (conferences, open-source communities, recruiting events). • Build a culture of documentation, reliability, and platform-as-a-product thinking across all data platform engineering functions. • Participate in goal planning cycles as a technical voice; define engineering-led goals that improve platform reliability, developer experience, and data quality.

Job Requirements

  • 8–14 years of professional software or data engineering experience, with at least 3 years in a technical lead, principal, capacity on a data platform or distributed systems team.
  • Demonstrated track record of leading large-scale, cross-functional data infrastructure projects from conception through production with measurable business impact.
  • Deep expertise in distributed data systems: data warehouse/lakehouse architecture, streaming platforms, large-scale batch processing, and cloud-native data infrastructure.
  • Expert-level proficiency in Python and SQL; strong working knowledge of at least one JVM language (Scala or Java) for Spark or Flink development.
  • Deep knowledge of modern data warehouse and lakehouse platforms (Snowflake, BigQuery, Redshift, Databricks, or equivalent) including storage optimization, compute management, and cost governance.
  • Strong command of open table formats (Apache Iceberg, Delta Lake, or Apache Hudi) and their trade-offs in production lakehouse architectures.
  • Experience architecting and operating large-scale streaming pipelines with Apache Kafka, Kinesis, or Pub/Sub, including schema management, consumer group design, and exactly-once semantics..
  • Exceptional communication skills: ability to write clearly, present confidently, and adapt technical depth to a wide range of audiences from individual contributors to high level leaders.
  • Experience establishing engineering standards, review processes, and quality gates across multi-team engineering organizations.

Benefits

  • Medical, Dental, Vision, Prescription Coverage (22.5 hours per week or above for full-time and part-time team members)
  • Life & AD&D Insurance.
  • Short-Term and Long-Term Disability (with options to supplement)
  • 403(b) Retirement Plan: Employer match, additional non-elective contribution
  • PTO & Paid Sick Leave
  • Tuition Assistance, Advancement & Academic Advising
  • Parental, Adoption, Surrogacy Leave
  • Backup and On-Site Childcare
  • Well-Being Rewards
  • Employee Assistance Program (EAP)
  • Fertility Benefits, Healthy Pregnancy Program
  • Flexible Spending & Commuter Accounts
  • Pet, Home & Auto, Identity Theft and Legal Insurance

Related Categories

Related Job Pages

More Platform Engineer Jobs

Kooku Recruiting GmbH - Interim Recruiting & RPO logo

Senior Platform Engineer, Cloud & Infrastructure

Kooku Recruiting GmbH - Interim Recruiting & RPO

Personalberatung für digitales Recruiting und Interim HR Management

Full TimeRemoteTeam 11-50H1B No Sponsor

• You build out the cloud and infrastructure for a production-grade platform • You introduce new cloud components for persistence, monitoring, and security • You establish a resilient operations foundation with logging, observability, and CI/CD pipelines • You provision cloud resources consistently and maintainably using Infrastructure as Code • You prepare technical foundations for robust artifact management and controlled audit access • You make well-founded technical decisions and surface risks early • You drive larger topics pragmatically into viable implementations

Germany
€80K - €110K / year
Bridgeway Benefit Technologies logo

Senior Platform Engineer

Bridgeway Benefit Technologies

Leader in technology solutions for the Taft-Hartley industry.

Full TimeRemoteTeam 201-500H1B No Sponsor

• Iteratively design and develop scalable, resilient, and efficient platform solutions using cloud services and modern software design frameworks. • Create modular, reusable infrastructure using Terraform and related tools. • Partner interdepartmentally and cross-functionally to strengthen DevOps practices through automation. • Architect, develop, and maintain CI/CD pipelines for platform functions and customer needs at scale. • Deliver solutions based on event-driven, object-oriented, and functional design patterns. • Own the design and implementation of monitoring and logging solutions to ensure reliability and performance. • Support the definition and maintenance of a lifecycle process for platform systems to ensure updates, patches, and security compliance. • Apply deep expertise in platform engineering while leveraging cross-disciplinary knowledge to drive effective collaboration across development, operations, and security teams. • Resolve cloud infrastructure issues quickly, analyze performance, and implement improvements. • Analyze system performance and implement optimizations to improve speed, efficiency, and resource utilization. • Anticipate and plan infrastructure scaling to meet the growing needs of the business. • Apply a security-first approach, ensuring SOC, SOC2, HIPAA, NIST, and regulatory requirements are met. • Implement and manage IAM, firewalls, and SIEM solutions. • Integrate diverse and non-traditional systems to deliver practical, forward-thinking outcomes. • Navigate challenges creatively and find effective solutions when conventional approaches fall short. • Lead assigned projects, driving cross-team collaboration, execution delivery, and accountability. • Write clean, efficient, and well-documented code while following best practices and established development standards. • Take part in the on-call rotation to ensure the reliability and availability of platform services. • Use generative AI tools such as Claude, Copilot, or ChatGPT to improve productivity and deliver high-quality outcomes.

United States

AI Platform Engineer

Katapult Labs

Katapult is an AI-augmented nearshore software development agency building great products at startups and businesses.

Full TimeRemoteTeam 11-50Since 2022H1B No Sponsor

• Design, build, and maintain scalable ML, AI, and data-platform services that power production features end-to-end. • Operate LLM applications in production: chat with memory, retrieval, prompt management, versioning, and experimentation. • Build and run structured evaluation pipelines (golden datasets, regression checks) so changes ship with confidence. • Own AI/ML observability and monitoring instrument, trace, and debug model behavior in prod with tools like Langfuse or MLflow (knowing one is enough). • Integrate and serve LLM-agnostic model backends (e.g., Anthropic models via Bedrock and Vertex) and support deterministic/custom ML where open-source models fall short (e.g., document/PDF parsing). • Contribute to data lineage, governance, and compliance as the platform matures. • Partner closely with product and the broader team to move fast without breaking quality.

Colombia
The Saros Group logo

Cloud & Data Platform Security Engineer

The Saros Group

Highly Skilled & Experienced Management Consulting Professionals Aligned to Execute

ContractRemoteTeam 11-50Since 2017H1B No Sponsor

• Design and enforce RBAC/ABAC policies, SCIM provisioning, and SSO/MFA for Databricks workspaces. • Manage identity lifecycle, including onboarding/offboarding and periodic access reviews. • Integrate Databricks and AWS services with enterprise IAM solutions (e.g., Azure AD, Okta). • Implement AWS IAM roles, policies, and permission boundaries for secure data access. • Ensure secure integration between AWS, Databricks, and Microsoft Power BI for reporting. • Develop and maintain security architecture for AWS and Databricks environments supporting Power BI analytics. • Design secure data pipelines and enforce encryption in transit and at rest across AWS S3, Databricks, and Power BI. • Implement network security controls (VPC, security groups, private endpoints) for AWS and Databricks connectivity. • Lead requirements gathering sessions with stakeholders to define security needs for AWS, Databricks, and Power BI integrations. • Document security requirements, architecture diagrams, and implementation plans. • Maintain detailed security design documentation and update as environments evolve. • Investigate and respond to IAM-related and platform security incidents and defects. • Ensure adherence to SOC 2, HIPAA, GDPR, and internal security standards across AWS and Databricks. • Implement data governance policies for sensitive data used in Power BI reporting. • Apply Databricks Security Profile features (CIS-hardened images, FIPS 140 encryption, TLS 1.2+). • Validate secure cluster configurations and enforce encryption policies in Databricks and AWS. • Harden AWS services (EC2, S3, IAM) following CIS benchmarks and best practices. • Partner with data engineering, BI, and cloud teams to implement security best practices. • Provide security posture reports and IAM metrics to leadership. • Support secure integration of Power BI with AWS and Databricks for enterprise reporting.

United States