Live Life Well...Love Your Work.
Lead Data Platform Engineer
Location
New Jersey
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Lead Data Platform Engineer
CentraState Healthcare System
• Own the technical architecture of the data platform end-to-end: ingestion, storage, transformation, orchestration, serving, and observability layers. • Author and maintain the platform architectural vision document; lead quarterly architecture reviews to assess alignment with organizational goals and technology trends. • Define and evolve the target-state architecture for the platform, establishing a multi-year technology roadmap in partnership with engineering leadership. • Evaluate emerging technologies, frameworks, and make evidence-based adoption recommendations. • Serve as the final technical escalation point for complex design questions, cross-team conflicts, and build-vs-buy decisions affecting the platform. • Lead the planning, execution, and delivery of multi-quarter platform initiatives involving multiple engineers, cross-functional dependencies, and significant organizational impact. • Break down large, ambiguous programs into scoped workstreams; assign technical leads per workstream, define milestones, and manage cross-team dependencies and risk. • Drive initiative kick-offs with clear problem framing, success criteria, architectural constraints, and delivery phasing — from 0-to-1 exploration through production hardening. • Maintain stakeholder alignment throughout delivery: proactively communicate status, surface trade-offs, and escalate blockers to leadership before they become risks. • Lead post-mortems and retrospectives for large initiatives; document and socialize lessons learned to raise the organizational bar on delivery excellence. • Exercise functional oversight across the EDAP team: review technical designs, set quality gates, approve architectural decisions, and ensure consistency of implementation patterns. • Define, document, and socialize platform engineering standards including coding conventions, testing requirements, CI/CD practices, schema design guidelines, and SLA frameworks. • Establish and own the platform's technical review process (design review): triage incoming projects, chair review sessions, and ensure decisions are documented and traceable. • Identify and drive resolution of technical debt, redundancy, and architectural drift that impede platform reliability, developer productivity, or scalability. • Partner with security, compliance, and infrastructure teams to ensure platform systems meet governance, data privacy, and regulatory requirements by design. • Serve as a primary technical mentor for junior and senior data platform engineers across the platform; provide structured coaching on system design, technical communication, and engineering judgment. • Conduct and lead design reviews, architecture critiques, and technical deep-dives that strengthen the overall capability of the engineering team. • Define what technical excellence looks like at each level of engineers and participate in calibration discussions. • Represent the data platform in engineering-wide forums, all-hands, and external venues (conferences, open-source communities, recruiting events). • Build a culture of documentation, reliability, and platform-as-a-product thinking across all data platform engineering functions. • Participate in goal planning cycles as a technical voice; define engineering-led goals that improve platform reliability, developer experience, and data quality.
Job Requirements
- 8–14 years of professional software or data engineering experience, with at least 3 years in a technical lead, principal, capacity on a data platform or distributed systems team.
- Demonstrated track record of leading large-scale, cross-functional data infrastructure projects from conception through production with measurable business impact.
- Deep expertise in distributed data systems: data warehouse/lakehouse architecture, streaming platforms, large-scale batch processing, and cloud-native data infrastructure.
- Expert-level proficiency in Python and SQL; strong working knowledge of at least one JVM language (Scala or Java) for Spark or Flink development.
- Deep knowledge of modern data warehouse and lakehouse platforms (Snowflake, BigQuery, Redshift, Databricks, or equivalent) including storage optimization, compute management, and cost governance.
- Strong command of open table formats (Apache Iceberg, Delta Lake, or Apache Hudi) and their trade-offs in production lakehouse architectures.
- Experience architecting and operating large-scale streaming pipelines with Apache Kafka, Kinesis, or Pub/Sub, including schema management, consumer group design, and exactly-once semantics..
- Exceptional communication skills: ability to write clearly, present confidently, and adapt technical depth to a wide range of audiences from individual contributors to high level leaders.
- Experience establishing engineering standards, review processes, and quality gates across multi-team engineering organizations.
Benefits
- Medical, Dental, Vision, Prescription Coverage (22.5 hours per week or above for full-time and part-time team members)
- Life & AD&D Insurance.
- Short-Term and Long-Term Disability (with options to supplement)
- 403(b) Retirement Plan: Employer match, additional non-elective contribution
- PTO & Paid Sick Leave
- Tuition Assistance, Advancement & Academic Advising
- Parental, Adoption, Surrogacy Leave
- Backup and On-Site Childcare
- Well-Being Rewards
- Employee Assistance Program (EAP)
- Fertility Benefits, Healthy Pregnancy Program
- Flexible Spending & Commuter Accounts
- Pet, Home & Auto, Identity Theft and Legal Insurance
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
Senior Platform Engineer, Cloud & Infrastructure
Kooku Recruiting GmbH - Interim Recruiting & RPOPersonalberatung für digitales Recruiting und Interim HR Management
• You build out the cloud and infrastructure for a production-grade platform • You introduce new cloud components for persistence, monitoring, and security • You establish a resilient operations foundation with logging, observability, and CI/CD pipelines • You provision cloud resources consistently and maintainably using Infrastructure as Code • You prepare technical foundations for robust artifact management and controlled audit access • You make well-founded technical decisions and surface risks early • You drive larger topics pragmatically into viable implementations
Senior Platform Engineer
Bridgeway Benefit TechnologiesLeader in technology solutions for the Taft-Hartley industry.
• Iteratively design and develop scalable, resilient, and efficient platform solutions using cloud services and modern software design frameworks. • Create modular, reusable infrastructure using Terraform and related tools. • Partner interdepartmentally and cross-functionally to strengthen DevOps practices through automation. • Architect, develop, and maintain CI/CD pipelines for platform functions and customer needs at scale. • Deliver solutions based on event-driven, object-oriented, and functional design patterns. • Own the design and implementation of monitoring and logging solutions to ensure reliability and performance. • Support the definition and maintenance of a lifecycle process for platform systems to ensure updates, patches, and security compliance. • Apply deep expertise in platform engineering while leveraging cross-disciplinary knowledge to drive effective collaboration across development, operations, and security teams. • Resolve cloud infrastructure issues quickly, analyze performance, and implement improvements. • Analyze system performance and implement optimizations to improve speed, efficiency, and resource utilization. • Anticipate and plan infrastructure scaling to meet the growing needs of the business. • Apply a security-first approach, ensuring SOC, SOC2, HIPAA, NIST, and regulatory requirements are met. • Implement and manage IAM, firewalls, and SIEM solutions. • Integrate diverse and non-traditional systems to deliver practical, forward-thinking outcomes. • Navigate challenges creatively and find effective solutions when conventional approaches fall short. • Lead assigned projects, driving cross-team collaboration, execution delivery, and accountability. • Write clean, efficient, and well-documented code while following best practices and established development standards. • Take part in the on-call rotation to ensure the reliability and availability of platform services. • Use generative AI tools such as Claude, Copilot, or ChatGPT to improve productivity and deliver high-quality outcomes.
AI Platform Engineer
Katapult LabsKatapult is an AI-augmented nearshore software development agency building great products at startups and businesses.
• Design, build, and maintain scalable ML, AI, and data-platform services that power production features end-to-end. • Operate LLM applications in production: chat with memory, retrieval, prompt management, versioning, and experimentation. • Build and run structured evaluation pipelines (golden datasets, regression checks) so changes ship with confidence. • Own AI/ML observability and monitoring instrument, trace, and debug model behavior in prod with tools like Langfuse or MLflow (knowing one is enough). • Integrate and serve LLM-agnostic model backends (e.g., Anthropic models via Bedrock and Vertex) and support deterministic/custom ML where open-source models fall short (e.g., document/PDF parsing). • Contribute to data lineage, governance, and compliance as the platform matures. • Partner closely with product and the broader team to move fast without breaking quality.
Cloud & Data Platform Security Engineer
The Saros GroupHighly Skilled & Experienced Management Consulting Professionals Aligned to Execute
• Design and enforce RBAC/ABAC policies, SCIM provisioning, and SSO/MFA for Databricks workspaces. • Manage identity lifecycle, including onboarding/offboarding and periodic access reviews. • Integrate Databricks and AWS services with enterprise IAM solutions (e.g., Azure AD, Okta). • Implement AWS IAM roles, policies, and permission boundaries for secure data access. • Ensure secure integration between AWS, Databricks, and Microsoft Power BI for reporting. • Develop and maintain security architecture for AWS and Databricks environments supporting Power BI analytics. • Design secure data pipelines and enforce encryption in transit and at rest across AWS S3, Databricks, and Power BI. • Implement network security controls (VPC, security groups, private endpoints) for AWS and Databricks connectivity. • Lead requirements gathering sessions with stakeholders to define security needs for AWS, Databricks, and Power BI integrations. • Document security requirements, architecture diagrams, and implementation plans. • Maintain detailed security design documentation and update as environments evolve. • Investigate and respond to IAM-related and platform security incidents and defects. • Ensure adherence to SOC 2, HIPAA, GDPR, and internal security standards across AWS and Databricks. • Implement data governance policies for sensitive data used in Power BI reporting. • Apply Databricks Security Profile features (CIS-hardened images, FIPS 140 encryption, TLS 1.2+). • Validate secure cluster configurations and enforce encryption policies in Databricks and AWS. • Harden AWS services (EC2, S3, IAM) following CIS benchmarks and best practices. • Partner with data engineering, BI, and cloud teams to implement security best practices. • Provide security posture reports and IAM metrics to leadership. • Support secure integration of Power BI with AWS and Databricks for enterprise reporting.



