Whatnot is an online community marketplace where people can work to “turn their passion into a business.” In past hiring for flexible roles, the venture-bac
Data Engineer, Payments
Location
California + 2 moreAll locations: California | New York | Washington
Posted
12 days ago
Salary
$180K - $260K / year
Seniority
Senior
Job Description
Data Engineer, Payments
Whatnot
• Own data architecture end-to-end. Define how we capture, model, and serve critical business data then implement it in production. You’ll make architectural decisions around storage formats, compute patterns, and SLAs that balance cost, scalability, and consistency. • Build mission-critical pipelines. Develop and operate streaming and batch data workflows that process high-volume events across multiple domains user activity, transactions, experimentation, marketing performance, and operational telemetry with tight guarantees for latency, completeness, and accuracy. • Design and implement canonical models. Create domain-oriented data models that serve as the source of truth for analytics, ML, and real-time applications. Establish and enforce modeling standards, ownership boundaries, and data contracts across teams. • Enforce data quality at scale. Build tests, lineage, monitoring, and reconciliation systems that make every dataset observable and every anomaly actionable. • Automate operational workflows. Partner with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems. • Enable insights and experimentation. Support analytics, ML, and product engineering teams by exposing high-quality, low-latency data through semantic layers, APIs, and real-time query systems.
Job Requirements
- Have a minimum of 3+ years of experience as a data or software engineer building data warehouses, distributed data systems, or event-driven architectures.
- Can design and implement data models using dimensional, Data Vault, or ledger-style techniques that support analytical and transactional workloads.
- Have deep hands-on expertise with modern data tooling across ingestion (e.g., Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), and observability (Monte Carlo, Great Expectations).
- Have operated cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.
- Are comfortable writing production-grade code in Python or SQL languages, and integrating with CI/CD and infrastructure-as-code workflows.
- Enjoy partnering across disciplines engineering, product, analytics to translate messy business requirements into elegant data systems.
- Thrive as a self-starter in a fast-moving environment, owning both the technical design and the operational outcomes of your work.
Benefits
- Generous Holiday and Time off Policy
- Health Insurance options including Medical, Dental, Vision
- Work From Home Support
- Home office setup allowance
- Monthly allowance for cell phone and internet
- Care benefits
- Monthly allowance for wellness
- Annual allowance towards Childcare
- Lifetime benefit for family planning, such as adoption or fertility expenses
- Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
- Monthly allowance to dogfood the app
- Parental Leave
- 16 weeks of paid parental leave + one month gradual return to work
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
FastlyFastly’s edge cloud platform enables the best of the web to thrive, and helps you deliver better online experiences.
• Collaborate and partner with stakeholders, and decision-makers to prioritize, design, and fulfill their data analytics needs. • Identify KPIs driving business growth and performance and work closely with the business teams to define them. • Work across the data stack to design and build various data products (pipelines, data models, analysis) that enable the business to make data backed decisions. • Help garner trust in data from the business by documenting analytics best practices, assisting with data discoverability, governance, and accuracy. • Promote and drive a self-service data culture by building easy to use analytics products and teaching the technical and non-technical users how to use them. • Communicate progress, risks, and completion of projects to stakeholders.
• Design, build and evolve the company’s data platform architecture. • Develop and maintain ETL/ELT pipelines, including API extraction, transformations, incremental loads and CDC (Change Data Capture). • Model data for Data Warehouse, Data Lake and Data Marts, applying dimensional modeling (Star Schema, Snowflake Schema). • Implement batch and streaming processing with event-driven architecture and asynchronous processing. • Ensure database performance and reliability: relational modeling, indexes, partitioning, query optimization and replication. • Establish Data Quality, Data Lineage, Data Catalog and Data Governance practices. • Orchestrate pipelines and handle historical data with versioning and traceability. • Implement pipeline observability: logs, metrics, monitoring and alerts. • Provide reliable and near real-time data for dashboards, operational analytics and business intelligence. • Prepare the data foundation for future Machine Learning initiatives. • Automate processes and deployments using GitHub Actions and Docker. • Collaborate with product, engineering and business teams to define requirements and KPIs.
• Design, develop and maintain scalable data pipelines to ingest, process and transform large volumes of structured and unstructured data from diverse sources. • Implement efficient processes to ensure accurate and timely delivery of data to downstream systems and applications. • Ensure data quality, security and governance across the entire pipeline.
Lead GCP Data Architect
Naveera Technology LLCEngineering Production-Ready Data, AI & Cloud Platforms - Scalable, Secure, and Built for Enterprise Growth.
• Collaborate with Product Managers, Business Analysts, DevOps teams, Engineering teams, PMO. • Deliver scalable enterprise cloud solutions. • Provide architectural options and technical recommendations. • Conduct cost-benefit analysis and risk assessments. • Lead the modernization of data platforms, ETL pipelines, and analytics ecosystems.




