Darkroom logo
Darkroom

We fuel growth for the world's best brands.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

Pakistan

Posted

45 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Darkroom

• Build and scale the ingestion layer across third-party marketing APIs (Meta, Google, TikTok, GA4, Shopify, Klaviyo, and more) — auth, extraction, rate-limit handling, backfill, and incremental sync. • Design normalization and transformation pipelines that map messy, platform-specific data into shared, queryable schemas (e.g. a unified creative/campaign/order model). • Own data reliability at scale — sync accuracy, freshness, coverage, and observability. Build the systems that detect when a connection breaks or a number looks wrong before a user does. • Engineer for multi-tenant scale and security: pipelines and storage that stay performant and cost-efficient across 1,000+ users and hundreds of connected brands — with strict data isolation, privacy, and compliance built in, not bolted on. • Partner with the AI and data-science teams to expose clean, well-modeled data the agent can retrieve and reason over.

Job Requirements

  • Experience building and operating large enterprise data pipelines engineered for scale — systems serving 1,000+ users (or equivalent data volume / tenancy), where reliability, isolation, and cost at scale were real constraints you solved.
  • Strong SQL and Python, with production experience in a modern data warehouse (BigQuery, Snowflake, Redshift, or similar).
  • Deep familiarity with ETL/ELT patterns, incremental sync, schema design, and data modeling for analytics.
  • Built and maintained integrations against third-party APIs — OAuth flows, pagination, rate limits, schema drift, and the operational reality of connectors that break.
  • A bias toward observability and data quality: you instrument your pipelines and you don't ship data you can't trust.
  • Experience building or operating within SOC 2-compliant systems with enterprise-grade security and privacy — you've handled sensitive customer data under real compliance constraints (access controls, encryption, data isolation, auditability) and treat it as a first-class engineering requirement.

Benefits

  • Product Ownership: You'll ship production code daily and help steer key product and technical decisions.
  • Shape the Engineering Culture: You'll influence how we work—tools, processes, standards, and hiring.
  • Work with Challenger Consumer Brands: Talk directly to customers (CEOs, CMOs, VP's) of fast-growing consumer brands—some doing $80M–$500M in revenue.

Related Categories

Related Job Pages

More Data Engineer Jobs

Wurl logo

Senior Data Engineer

Wurl

Wurl, Inc., also known as Wurl Network, is a connected TV (CTV) network founded in 2017 to connect the world's largest media brands with the largest TV streamin

Data Engineer45 days ago

• Evolve and streamline Wurl’s data ETL processes, Business Intelligence dashboards (internal and external) enhancement, data workflows (with emphasis on scale, security, maintainability, and validation), data warehousing processes, and internal/external monitoring, alarming, and reporting. • Act as a data team representative and gather requirements from the internal customers such as data science, sales team, etc.

California + 2 moreAll locations: California | New York | Washington
$166K - $275K / year
Builders FirstSource logo

Lead Engineer, IT - SAP Data Services

Builders FirstSource

Builders FirstSource is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status or status as an individual with a disability.

Data Engineer45 days ago
Full TimeRemoteTeam 10,001

Role Description This role is for a Technical Lead with ownership over the SAP Data Migration aspects of the BFS Data Engineering Team. The ideal candidate will have experience leading the technical aspects of the Data Migration team including: - Providing oversight and ownership over the technical architecture and end-to-end development process. - Implementing data migration solutions using SAP Data Services. - Ensuring timely delivery of high-quality, reliable, and cost-effective migration solutions from diverse ERP sources into SAP S/4 Hana and Azure Cloud. - Defining design guidelines using best practices related to SAP Data Services. - Coding/building pipelines, peer reviews, and general oversight. - Developing the cloud data platform as the environment matures. Qualifications - Bachelor's degree from an accredited college/university. - 7+ years relevant work experience or an equivalent combination of education and experience. - Experience leading ETL on multiple SAP data migration projects from end to end. - Demonstrated high involvement with SAP data object migration processes/tools and complex data extractions, transformations, and loading techniques. - Experience in SAP Data Migration Toolset: SAP Data Services (BODS), iDoc, BAPI, LSMW, RFC, DMC. - Experience in Azure data engineering toolset: Databricks, Microsoft SQL Databases (SQLMI), Azure DevOps. - Experience in basic data warehousing and modeling practices and techniques. - Operating System Technologies: Windows, Linux/Unix including VMs. - Database Technologies: Microsoft SQL, S/4 Hana, Sybase, ODBC/JDBC connection management. - Programming Languages: SQL, Python. Requirements - Manages and resolves data conversion issues during loading, upon consulting with functional team/client. - Demonstrated experience in performance tuning pipelines and applications related to the Data Migration process. - Demonstrated experience in IT security practices in data at rest and in motion. - Maintain Technical and Functional Documentation/Standards including Field Mapping, Validations, Process Flows, Relevancy Rules, etc. Benefits - Medical, dental, vision, and disability insurance plans. - 401(k) retirement savings plan. - PTO (including paid sick time). - 8 paid holidays per year (for salaried and hourly team members). Company Description Builders FirstSource is America’s largest supplier of building materials, value-added components, and building services to the professional market. We are committed to creating a diverse and inclusive workplace that welcomes candidates from all backgrounds and experience levels.

United States
Tern logo

AI, Data Engineer

Tern

Fintech for Everyone

Data Engineer45 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Build and ship the systems behind Tern's AI features • Build the evaluation systems that answer whether an AI feature is good enough to ship and good enough to keep • Own data quality as a first-class concern • Build and maintain the ETL systems • Work alongside product squads to build reporting

United States
$145K - $175K / year

Senior Data Engineer

Branch

Branch, founded in 2014, is a trailblazer in mobile linking and measurement, powering seamless digital experiences for over 100,000 apps and reaching more than

Data Engineer45 days ago

• Own end-to-end data systems and pipelines, that other teams and customers rely on • Design and implement data integrations across multiple backend business systems, ensuring efficient and reliable data flows • Work on streaming data processing using frameworks like Apache Beam to handle real-time data ingestion and transformation • Build and maintain APIs to enable seamless data access and sharing across internal teams and platforms • Manage orchestration and automation of workflows using Airflow on Kubernetes • Define what "correct" means for the data you own, and back it with monitoring, alerting, and integration tests • Build reusable patterns and components (hooks, plugins, alerting utilities) that are easily adoptable by other engineers and processes • Break down ambiguous work into actionable tasks, surface edge cases and failure modes early, and clarify requirements with stakeholders • Communicate tradeoffs, assumptions, and risks clearly in design reviews and PRs

United States
$160K - $175K / year