Whatnot is an online community marketplace where people can work to “turn their passion into a business.” In past hiring for flexible roles, the venture-bac
Software Engineer, Data Foundations
Location
Northern America + 2 moreAll locations: Northern America | Europe | Australia and New Zealand
Posted
6 days ago
Salary
$200K - $275K / year
Seniority
Mid Level
Job Description
Software Engineer, Data Foundations
Whatnot
Role Description The Data Platform team at Whatnot builds services that improve our core product experience and unlock meaningful business value. In this role, you will: - Define technical direction and lead development of critical data platform systems that power next-generation capabilities at Whatnot. - Lead the buildout and evolution of our data orchestration and streaming platforms, helping drive them from early platform investment to production-ready usage across the company. - Design scalable, reliable, multi-tenant data infrastructure rather than simply building pipelines on top of an existing platform. - Own core platform concerns including scalability, performance, reliability, SLOs, and operational excellence for data processing systems. - Build high-quality systems that support real-time analytics, event-driven applications, and machine learning infrastructure needs across Whatnot. - Make key decisions about how data systems should be integrated across Whatnot, and then partner cross-functionally to bring that architecture to life. - Collaborate closely with engineering partners across product, platform, machine learning, and data to enable fast, safe, and scalable development. - Help shape broader company architecture across orchestration, stream processing, real-time systems, analytics, and content understanding. - Apply DevOps/SRE practices, including CI/CD, infrastructure automation, monitoring, and incident response, to keep platform systems reliable at scale. - Help define and enforce data governance and compliance standards across our data lake and downstream systems. Qualifications - 8+ years of experience in software engineering. - Ability to write well-tested, API-driven applications and services that run at scale in production. - Track record of building scalable, high-performance distributed systems. - Strong experience with streaming data systems (e.g., Kafka, Flink, or Pulsar) and/or orchestration platforms (e.g., Airflow, Dagster, or Temporal). - Hands-on experience designing and operating stateful, real-time data pipelines at scale, including concepts like checkpointing, state management, and watermarking. - Experience evaluating architectural tradeoffs in data processing and orchestration systems. - Experience building multi-tenant or end-to-end data infrastructure that supports multiple teams or production use cases. - Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) and data lake architectures (e.g., AWS S3). - Strong experience supporting operational systems to ensure uptime, reliability, and maintainability. - Familiarity with DevOps/SRE practices and CI/CD tooling, including GitHub and GitHub Actions. - Understanding of data governance and compliance principles. Requirements - Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (for example, Terraform). - Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles. - Self-starter ethic, with the ability to thrive under a high level of autonomy. - Exceptional interpersonal and communication skills. Benefits - Generous Holiday and Time off Policy. - Health Insurance options including Medical, Dental, Vision. - Work From Home Support. - Home office setup allowance. - Monthly allowance for cell phone and internet. - Care benefits. - Monthly allowance for wellness. - Annual allowance towards Childcare. - Lifetime benefit for family planning, such as adoption or fertility expenses. - Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally. - Monthly allowance to dogfood the app. - Parental Leave: 16 weeks of paid parental leave + one month gradual return to work. Company Description Whatnot is the largest live shopping platform in North America and Europe to buy, sell, and discover the things you love. We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes.
Related Guides
Related Categories
Related Job Pages
More Data Scientist Jobs
Senior Data Science Consultant, Insurance
AAAProud to serve our 62+ million members, help travelers see the world and drive real change to improve road safety.
• Lead the design, development, and validation of simulation models (discrete-event, agent-based, system dynamics, or hybrid) • Translate business or operational problems into robust simulation frameworks • Conduct scenario analysis, what-if studies, optimization, and risk analysis • Interpret simulation results and large datasets, delivering actionable insights to executive and technical audiences to support decision-making • Guide business users on model assumptions, limitations, and best practices • Coach and mentor junior consultants and review modeling work for quality and rigor
Senior Data Manager
HumanaLouisville, Kentucky-based Humana is a leading healthcare company that offers a variety of health, wellness, and insurance products and services designed to off
• acquire, clean and develop datasets from internal and external sources to support business analysis and reporting • acquire, validate, store, protect, and adhere to processes around data to ensure the accessibility, reliability, and timeliness of the data for its users • develop and execute data architectures, policies, practices and procedures that properly manage the full data lifecycle needs of an enterprise • interact with business and IT departments in understanding user needs • translate business needs to technical requirements in terms of data needs • manage multiple priorities and meet deadlines • maintain confidentiality and work independently • identify opportunities for process improvements • coordinate with other teams to ensure all aspects of data needs are taken into account • coordination and completion of projects on time and within scope • prepare data for reporting and analysis including visualizations to support business requirements • perform in-depth data analysis to derive insights that drives business outcomes and decisions • exhibit strong written and verbal communication skills • be an innovative thinker with an innate curiosity around data • experience in problem analysis and process documentation
• Own the full data platform — the warehouse, streaming and batch ingestion, the semantic layer, and BI infrastructure. • Define and enforce data governance — access management, quality standards, and a well-modeled, trustworthy "gold" layer. • Make the warehouse the source of truth for operational, product, and financial analytics. • Build the models that power delivery intelligence — forecasting, prediction, optimization, matching/allocation, and reliability scoring that turn our data into better real-time decisions. • Stand up the ML systems that make this real and reliable: feature pipelines, training, serving, evaluation, and drift monitoring. • Design the learning loop — instrument decisions and outcomes so models continuously improve. • Drive the AI agent initiative to production, partnering with product and engineering on the surrounding workflows. • Manage and grow the data and ML team (starting from a small core) — hire data engineers, analytics engineers, and data scientists/ML engineers as the platform matures. • Establish a clear intake process for ad hoc data requests so the team works from a roadmap, not in reactive mode. • Partner with Sales, Customer Success, and Finance on data-driven analyses and decisions.
Data Science Coach
LelandAccess coaching, courses, and content powered by 1,000+ career and admissions experts.
• Work with clients looking to break into or grow within data science roles • Teach core data science strategy, machine learning, and predictive modeling skills • Help clients strengthen data cleaning and preprocessing, data visualization, statistical analysis, and data pipeline automation practices • Guide clients on applying emerging tools like AI fundamentals, AI model evaluation, and AI automation • Offer resume review, LinkedIn review, and cover letter guidance • Conduct behavioral and technical interview prep tailored to data science roles • Provide networking strategy, salary negotiation, promotion strategy, broader skill building, and support for those pursuing freelancing opportunities




