We fuel growth for the world's best brands.
Senior Data Engineer
Location
Pakistan
Posted
54 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Darkroom
• Build and scale the ingestion layer across third-party marketing APIs (Meta, Google, TikTok, GA4, Shopify, Klaviyo, and more) — auth, extraction, rate-limit handling, backfill, and incremental sync. • Design normalization and transformation pipelines that map messy, platform-specific data into shared, queryable schemas (e.g. a unified creative/campaign/order model). • Own data reliability at scale — sync accuracy, freshness, coverage, and observability. Build the systems that detect when a connection breaks or a number looks wrong before a user does. • Engineer for multi-tenant scale and security: pipelines and storage that stay performant and cost-efficient across 1,000+ users and hundreds of connected brands — with strict data isolation, privacy, and compliance built in, not bolted on. • Partner with the AI and data-science teams to expose clean, well-modeled data the agent can retrieve and reason over.
Job Requirements
- Experience building and operating large enterprise data pipelines engineered for scale — systems serving 1,000+ users (or equivalent data volume / tenancy), where reliability, isolation, and cost at scale were real constraints you solved.
- Strong SQL and Python, with production experience in a modern data warehouse (BigQuery, Snowflake, Redshift, or similar).
- Deep familiarity with ETL/ELT patterns, incremental sync, schema design, and data modeling for analytics.
- Built and maintained integrations against third-party APIs — OAuth flows, pagination, rate limits, schema drift, and the operational reality of connectors that break.
- A bias toward observability and data quality: you instrument your pipelines and you don't ship data you can't trust.
- Experience building or operating within SOC 2-compliant systems with enterprise-grade security and privacy — you've handled sensitive customer data under real compliance constraints (access controls, encryption, data isolation, auditability) and treat it as a first-class engineering requirement.
Benefits
- Product Ownership: You'll ship production code daily and help steer key product and technical decisions.
- Shape the Engineering Culture: You'll influence how we work—tools, processes, standards, and hiring.
- Work with Challenger Consumer Brands: Talk directly to customers (CEOs, CMOs, VP's) of fast-growing consumer brands—some doing $80M–$500M in revenue.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
WurlWurl, Inc., also known as Wurl Network, is a connected TV (CTV) network founded in 2017 to connect the world's largest media brands with the largest TV streamin
• Evolve and streamline Wurl’s data ETL processes, Business Intelligence dashboards (internal and external) enhancement, data workflows (with emphasis on scale, security, maintainability, and validation), data warehousing processes, and internal/external monitoring, alarming, and reporting. • Act as a data team representative and gather requirements from the internal customers such as data science, sales team, etc.
• Design, develop, and maintain scalable data pipelines to ingest, transform, validate, and store data from multiple internal and external systems. • Support enterprise analytics platforms by optimizing data models, schemas, and performance for reporting and dashboarding. • Implement data validation, reconciliation, and quality control processes to ensure accuracy, completeness, and reliability of IHSC data assets. • Support integration of healthcare, operational, and administrative data sources in alignment with enterprise data strategy. • Collaborate with Data Strategists, Data Analysts, and Solutions Developers to enable analytics use cases and reporting requirements. • Maintain documentation for data architectures, pipelines, transformations, and dependencies. • Support data governance initiatives, including metadata management, auditability, and lineage tracking. • Ensure data solutions comply with federal security, privacy, and regulatory requirements. • Assist with troubleshooting data issues and supporting operational continuity.
Lead Engineer, IT - SAP Data Services
Builders FirstSourceBuilders FirstSource is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status or status as an individual with a disability.
Role Description This role is for a Technical Lead with ownership over the SAP Data Migration aspects of the BFS Data Engineering Team. The ideal candidate will have experience leading the technical aspects of the Data Migration team including: - Providing oversight and ownership over the technical architecture and end-to-end development process. - Implementing data migration solutions using SAP Data Services. - Ensuring timely delivery of high-quality, reliable, and cost-effective migration solutions from diverse ERP sources into SAP S/4 Hana and Azure Cloud. - Defining design guidelines using best practices related to SAP Data Services. - Coding/building pipelines, peer reviews, and general oversight. - Developing the cloud data platform as the environment matures. Qualifications - Bachelor's degree from an accredited college/university. - 7+ years relevant work experience or an equivalent combination of education and experience. - Experience leading ETL on multiple SAP data migration projects from end to end. - Demonstrated high involvement with SAP data object migration processes/tools and complex data extractions, transformations, and loading techniques. - Experience in SAP Data Migration Toolset: SAP Data Services (BODS), iDoc, BAPI, LSMW, RFC, DMC. - Experience in Azure data engineering toolset: Databricks, Microsoft SQL Databases (SQLMI), Azure DevOps. - Experience in basic data warehousing and modeling practices and techniques. - Operating System Technologies: Windows, Linux/Unix including VMs. - Database Technologies: Microsoft SQL, S/4 Hana, Sybase, ODBC/JDBC connection management. - Programming Languages: SQL, Python. Requirements - Manages and resolves data conversion issues during loading, upon consulting with functional team/client. - Demonstrated experience in performance tuning pipelines and applications related to the Data Migration process. - Demonstrated experience in IT security practices in data at rest and in motion. - Maintain Technical and Functional Documentation/Standards including Field Mapping, Validations, Process Flows, Relevancy Rules, etc. Benefits - Medical, dental, vision, and disability insurance plans. - 401(k) retirement savings plan. - PTO (including paid sick time). - 8 paid holidays per year (for salaried and hourly team members). Company Description Builders FirstSource is America’s largest supplier of building materials, value-added components, and building services to the professional market. We are committed to creating a diverse and inclusive workplace that welcomes candidates from all backgrounds and experience levels.
• Build and ship the systems behind Tern's AI features • Build the evaluation systems that answer whether an AI feature is good enough to ship and good enough to keep • Own data quality as a first-class concern • Build and maintain the ETL systems • Work alongside product squads to build reporting
