S4 Capital Group logo
S4 Capital Group

a new age/new era digital advertising and marketing services company

Associate Director, Data Engineering

Data EngineerData EngineerFull TimeRemoteSeniorTeam 5,001-10,000Since 2018H1B No SponsorCompany SiteLinkedIn

Location

New York

Posted

1 day ago

Salary

$130K - $140K / year

Seniority

Senior

Bachelor Degree5 yrs expEnglishCloudPythonSQL

Job Description

Associate Director, Data Engineering

S4 Capital Group

• Design, build, and maintain scalable, reliable, and automated data pipelines using SQL, Python, and Databricks to support enterprise analytics. • Architect and optimize robust data models and infrastructure to ensure high data quality, integrity, and accessibility across the client's ecosystem. • Partner closely with the Data Science team to operationalize their work, deploying statistical and machine learning models into production environments using DataOps best practices. • Identify, design, and implement internal process improvements, including automating manual data processes and optimizing data delivery for scalability. • Collaborate with cross-functional teams to identify business problems, gather requirements, identify data sources, and provide data-driven solutions.

Job Requirements

  • A Bachelor’s or Master’s degree in Computer Science, Statistics, Applied Mathematics, or a related quantitative field (or equivalent practical experience)
  • 5+ years of experience in data engineering, data warehousing, or building data infrastructure for marketing and business applications
  • Strong experience designing and building scalable data pipelines using modern cloud data platforms.
  • Solid understanding of modern data architecture, including ELT, data lakes/lakehouses, data warehouses, and metadata-driven frameworks.
  • Experience applying software engineering best practices to data development, including:
  • Version control (Git)
  • Code reviews and pull request workflows
  • Modular, reusable, and testable code
  • CI/CD pipelines
  • Automated testing (unit, integration, and data quality tests)
  • Infrastructure as Code
  • Proficiency in Python and SQL, with a focus on clean, maintainable, and well-tested code.
  • Experience with orchestration frameworks and workflow automation.
  • Familiarity with data modeling, data governance, lineage, observability, and monitoring.
  • Experience working in Agile teams and collaborating across engineering, analytics, and business stakeholders.
  • Ability to design metadata-driven and configuration-driven solutions instead of hard-coded implementations.

Benefits

  • Excellent, full coverage medical, dental, and vision insurance - more about our coverage here!
  • Generous PTO and 15 company-wide holidays
  • 401k with company contribution
  • Paid parental leave
  • Work-life balance with an emphasis on personal well-being
  • Career growth in a disruptor space & entrepreneurial opportunities within the Monks network
  • A globally diverse & inclusive culture with employee resource groups such as S4 Melanin, Pride.Monks, Cultura.Monks, and more!
  • Authentic commitment to DEI efforts and sustainable growth.

Related Categories

Related Job Pages

More Data Engineer Jobs

Hone Health logo

Data Engineering Intern, Fall 2026

Hone Health

Hone is the premier men’s optimization clinic that helps men get their spark back and be their best self.

Data Engineer1 day ago
InternshipRemoteTeam 11-50Since 2020H1B No Sponsor

• Design, build, and maintain scalable data pipelines and ETL processes using Microsoft Fabric (Notebooks, Pipelines, Dataflows) to support analytics, reporting, and product use cases. • Integrate data from multiple internal and external sources, ensuring quality, consistency, and reliability across the medallion architecture. • Develop and maintain data models and transformations using dbt, contributing to bronze, silver, and gold layer modeling in the Fabric lakehouse. • Collaborate with engineers, analysts, and product teams to translate business requirements into technical data solutions — communicating through Slack and tracking work in Azure DevOps (ADO). • Participate in data quality checks, testing, validation, and performance optimization across pipeline and model layers. • Monitor, optimize, and troubleshoot data infrastructure for performance and scalability in a cloud-native Azure environment. • Follow engineering best practices around version control and CI/CD using GitHub, including branch management, pull requests, and code review. • Contribute to data documentation and ensure best practices around data governance, reliability, and scalability. • Contribute to the continuous improvement of data engineering processes and tools.

United States
$25 / hour
Hone Health logo

Contract Data Engineer

Hone Health

Hone is the premier men’s optimization clinic that helps men get their spark back and be their best self.

Data Engineer1 day ago
ContractRemoteTeam 11-50Since 2020H1B No Sponsor

• Design and build medallion architecture in dbt and Microsoft Fabric to enhance data analytics capabilities. • Create and maintain data ingestion pipelines to ensure efficient data flow and integration. • Establish data governance protocols, ensuring compliance with industry standards and best practices. • Implement data lineage and documentation to facilitate data traceability and transparency. • Develop and enforce data quality checks to maintain the integrity and accuracy of data assets. • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.

United States
Molina Healthcare logo

Senior Engineer, Big Data

Molina Healthcare

Molina Healthcare is a Fortune 500 managed care company with a storied history that dates back to 1980 and the opening of a medical clinic by Dr. C. David Molina. As an employer, M

Data Engineer1 day ago

Role Description Responsible for all the aspects of architecture, design and implementation of Data Management solution using Big Data platform on Cloudera or Hortonworks and other areas of enterprise application platforms. Reporting and analytics are very important for this position. Payment integrity is also important. Please update your resume with any relevant previous experience. - Convert concepts to technical architecture, design and implementation - Provide guidance on choosing ideal Architecture, Evaluating tools and Frameworks, define Standards & Best Practices for implementing scalable business solutions - Implement Batch and Real-time data ingestion/extraction processes through ETL, Streaming, API, etc., between diverse source and target systems with structured and unstructured datasets - Design and build data solutions with an emphasis on performance, scalability, and high-reliability - Code, test, and document new or modified data systems to create robust and scalable applications for data analytics - Build data model for analytics and application layers - Contribute to leading and building a team of top-performing data technology professionals - Help with project planning and scheduling - Expert level experience on Hadoop cluster components and services (like HDFS, YARN, ZOOKEEPER, AMBARI/CLOUDERA MANAGER, SENTRY/RANGER, KERBEROS, etc.) - Ability to participate and lead, in solving technical issues while engaged with infrastructure and vendor support teams. Qualifications - Bachelor's Degree - 5-7 years of data management experience. - Experience in building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming. - Proven experience on Big Data tools such as, Spark, Hive, Impala, Polybase, Phoenix, Presto, Kylin, etc. - Experience with integration of data from multiple data sources (using ETL tool such, Talend, etc.). - Experience building solutions with NoSQL databases, such as HBase, Memsql. - Strong experience on Database technologies, Data Warehouse, Data Validation & Certification, Data Quality, Metadata Management and Data Governance. - Experience with programming language such as, Java/Scala/Python, etc. - Experience implementing Web application and Web Services APIs (REST/SOAP). Requirements - Master's Degree (Preferred) - 7-10 years of data management experience (Preferred) - Experience in the healthcare industry is preferred. - Reporting and analytics are very important for this position. - Payment Integrity experience is very important for this opportunity. Benefits Molina Healthcare offers a competitive benefits and compensation package. Molina Healthcare is an Equal Opportunity Employer (EOE) M/F/D/V.

United States
$79.6K - $172.5K / year
Intetics logo

Senior Data Engineer

Intetics

Where software concepts come alive™

Data Engineer1 day ago
Full TimeRemoteTeam 501-1,000Since 1995H1B No Sponsor

Role Description Impact You Will Make in the Role: - Own Databricks production support for the company's data platform, including monitoring, alerting, and incident response across all production data flows. - Maintain and report on SLA performance metrics for data pipeline delivery, ensuring visibility into platform health and accountability across internal and external stakeholders. - Identify and implement pipeline optimizations that reduce Databricks compute costs, improve throughput, and reduce processing windows while tracking impacts through measurable KPIs. - Migrate legacy ETL/ELT pipelines to Databricks, building automation tooling to reduce manual intervention and ensure uninterrupted data delivery during transitions. - Support new customer onboarding by provisioning, validating, and hardening tenant data pipelines that deliver reliable, isolated data from day one. - Design and build high-performance Databricks pipelines that ingest, transform, and serve ERP and CRM data at scale across both Azure and AWS environments. - Own the Delta Lake architecture, including schema design, partitioning strategies, data quality enforcement, and incremental processing patterns. - Enforce data security best practices across Databricks environments, including role-based access control, secrets management, and compliance requirements for enterprise business data. - Implement data quality monitoring and observability across pipeline health and ML model inputs, ensuring data integrity that directly supports predictive analytics. - Apply and enforce multi-tenant data isolation patterns, ensuring reliable and secure data delivery across enterprise customers. - Partner with the Enterprise Architecture team to ensure data pipelines integrate seamlessly with the broader AI and analytics ecosystem. - Support a globally distributed operation through on-call rotation and after-hours incident response, meeting SLAs across multiple time zones. - Maintain technical documentation, runbooks, and architectural decision records, contributing to team knowledge sharing and operational readiness across on-call and incident response scenarios. - Apply CI/CD best practices to data pipeline development, including version control, automated testing, and deployment tooling to ensure reliable and repeatable pipeline delivery. Qualifications - 4+ years of data engineering experience. - At least 2 years of experience with Databricks or the Apache Spark ecosystem across Azure and/or AWS. - Proficiency in PySpark, SQL, and Python with a strong track record of building and operating production-grade pipelines under SLA constraints. - Hands-on experience with Delta Lake, including schema evolution, ACID transactions, optimize/vacuum lifecycle, and both incremental and streaming processing patterns. - Hands-on experience with pipeline performance tuning and compute optimization in production Databricks environments. - Solid working knowledge of PostgreSQL, including query optimization, schema design, and use as a source or sink in production data pipelines. - Experience supporting and maintaining legacy ETL tooling (SSIS, Informatica, custom Python/SQL pipelines, or similar) in production. - Experience supporting large-scale multi-tenant architectures with a focus on tenant isolation, per-tenant performance, and data privacy, including navigating tools and platforms that default to single-tenant assumptions. - Proven ability to work collaboratively across data science, product, and infrastructure teams, owning end-to-end delivery in a cross-functional environment. - Strong understanding of data governance, security, and compliance principles, including access control, data privacy, and protection of sensitive enterprise data across multi-tenant environments. Preferred Qualifications / Experience - Experience operating Databricks workspaces across both Azure and AWS, including cost governance, cluster management, and cross-cloud data access. - Experience optimizing Databricks workloads in a Serverless environment, including compute cost governance and performance tuning for serverless compute. - Experience with Microsoft SQL Server in a data engineering or ETL context. - Exposure to ML feature engineering or feature stores (Databricks Feature Store, Feast, or similar) supporting predictive analytics. - Experience with customer onboarding automation or Infrastructure as Code (IaC) patterns for provisioning tenant data pipelines at scale. - Databricks Certified Data Engineer Associate or Professional certification.

Slovakia