Job Closed
This listing is no longer active.
Reimagining real estate to make it easier than ever to move from one home to the next.
Senior Software Development Engineer (Big Data)
Location
United States
Posted
127 days ago
Salary
0
Job Description
Senior Software Development Engineer (Big Data)
Zillow
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description As a Senior Software Engineer (Big Data) on the Iron Chef team, you will design, build, and support data pipelines and data products that power machine learning (ML), AI-driven workflows, and analytics for Zillow Partner Agents. You will collaborate closely with product managers, engineers, data scientists, and analysts to create high-quality datasets and data products that surface the right customer opportunities at the right time. This is a high-impact role where you will improve data quality, reliability, and automation across our data engineering stack and contribute to the development and deployment of AI-driven systems used across Zillow. You Will Get To: - Collaborate with product managers, engineers, data scientists, and analysts to build, transform, and derive value from high-quality datasets that power machine learning, AI-driven workflows, and advanced analytics. - Design, build, and support scalable data pipelines and data products that serve ML, AI, and analytical use cases for Zillow Partner Agents. - Build self-service tools and platforms that address challenges for both data producers and data consumers, including integration and orchestration of AI-driven processes. - Contribute to shared infrastructure and tooling that enable reliable, scalable, and observable AI-powered systems. - Evaluate and drive adoption of new data and AI technologies that advance the team’s automation and AI capabilities. - Mentor, coach, and lead junior team members to help them grow into strong big data engineers. This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions. In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location. Qualifications - 5+ years of software development experience with high proficiency in Python, Java, Scala, or a similar programming language. - Strong knowledge of SQL, data structures, and algorithms, and experience building highly scalable and reliable data pipelines using technologies such as Spark, Hive, Trino/Presto, Airflow, Kafka, or Flink. - Experience with containerization and orchestration technologies, for example Docker and/or Kubernetes. - Familiarity with analytical and BI tools such as Tableau, Superset, or Mode Analytics, and experience working directly with customers or stakeholders to understand and capture requirements. - You care deeply about building high-quality tools, APIs, and platforms, and you use creativity and feedback to continuously improve them. - Nice to have: experience with data modeling and DevOps practices for running and supporting production systems. - Nice to have: experience with AI/ML systems, AI agents or workflows, or automation of data-driven processes. Company Description At Zillow, we’re reimagining how people move—through the real estate market and through their careers. As the most-visited real estate platform in the U.S., we help customers navigate buying, selling, financing and renting with greater ease and confidence. Whether you're working in tech, sales, operations, or design, you’ll be part of a company that's reshaping an industry and helping more people make home a reality. Zillow is honored to be recognized among the best workplaces in the country. Zillow was named one of FORTUNE 100 Best Companies to Work For® in 2025, and included on the PEOPLE Companies That Care® 2025 list, reflecting our commitment to creating an innovative, inclusive, and engaging culture where employees are empowered to grow. No matter where you sit in the organization, your work will help drive innovation, support our customers, and move the industry—and your career—forward, together. Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please contact your recruiter directly. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state and local law. Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Job Requirements
- 5+ years of software development experience with high proficiency in Python, Java, Scala, or a similar programming language.
- Strong knowledge of SQL, data structures, and algorithms, and experience building highly scalable and reliable data pipelines using technologies such as Spark, Hive, Trino/Presto, Airflow, Kafka, or Flink.
- Experience with containerization and orchestration technologies, for example Docker and/or Kubernetes.
- Familiarity with analytical and BI tools such as Tableau, Superset, or Mode Analytics, and experience working directly with customers or stakeholders to understand and capture requirements.
- You care deeply about building high-quality tools, APIs, and platforms, and you use creativity and feedback to continuously improve them.
- Nice to have: experience with data modeling and DevOps practices for running and supporting production systems.
- Nice to have: experience with AI/ML systems, AI agents or workflows, or automation of data-driven processes.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
AVAHIConseil en stratégie spécialisé dans l’impact investing - Accompagne les projets de développement inclusifs et durables
• Design, build, and maintain scalable AWS data platforms supporting batch and streaming pipelines, analytics, and AI/ML workloads, aligned with AWS Well-Architected best practices. • Build and operate data ingestion, transformation, and enrichment pipelines from internal systems and external APIs, handling structured, semi-structured, unstructured, and graph data. • Implement data normalization workflows to ensure consistent schemas, high data quality, and reliable analytics, BI, and ML use cases. • Design and enforce data governance including cataloging, lineage, access control, and auditability. • Build and maintain knowledge graphs to model relationships across core business entities, enabling advanced analytics and inference. • Identify data gaps, inconsistencies, and missing relationships using strong analytical and inference skills. • Integrate data from enterprise platforms such as CRM and ERP systems (Salesforce, HubSpot, SAP, NetSuite, Dynamics 365, Workday). • Design secure data access layers for analytics, BI, ML, and downstream applications. • Implement monitoring, observability, and data quality checks for freshness, completeness, and pipeline health. • Optimize data architectures for performance and cost efficiency using partitioning, indexing, compression, and storage tiering. • Build internal tooling, dashboards, and standardized scaffolding to improve visibility, maintainability, and onboarding. • Collaborate with cross-functional teams to deliver high-impact data solutions and share best practices, documentation, and technical guidance.
Lead Manager of Data Engineering
JobgetherWe use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description This role involves leading a dynamic data engineering team dedicated to developing innovative solutions grounded in AI technologies. - Lead the data engineering team and manage all associated activities. - Drive the development of data architecture leveraging AI innovations. - Implement data engineering templates and architectures for optimized performance. - Collaborate with product and architecture teams to enhance data strategies. - Stay updated on AI trends to enhance team performance and relevance. - Manage internal stakeholders and represent the organization to clients as needed. - Oversee team performance evaluations and professional development initiatives. - Define results and take action to meet organizational objectives. Qualifications - Bachelor’s degree or equivalent work experience. - 7+ years of experience in data engineering/IT/Project Management, including management experience. - 2+ years leading projects with proven project management methodologies. - Experience with data integration/ETL tools like databricks, Hadoop, and AWS tech stack. - Familiar with AI engineering concepts and tools. - Proficiency in software development and database management. - Excellent communication and interpersonal skills. Benefits - Competitive salary ranging from $130,000 to $165,000. - Discretionary bonus eligibility. - Comprehensive benefits package including medical, dental, and vision. - 401(k) savings plans. - Generous paid time off policies. - Flexible remote working conditions.
• Design, develop, and maintain robust, scalable data pipelines using Python and Airflow • Collaborate with Analytics Engineers and other team members to deliver clean, well-modeled data to downstream users • Implement monitoring, logging, and alerting to ensure data pipeline reliability and performance • Ensure data quality and integrity through validation frameworks and testing • Optimize performance and cost-efficiency of cloud-based data systems • Contribute to architectural decisions around data storage, workflow orchestration, and infrastructure as code • Document data pipelines and processes
• Build and maintain ETL pipelines that ingest daily Excel/CSV trade files, transform and validate the data, and persist it to PostgreSQL • Design and evolve database schemas using SQLAlchemy ORM and Alembic migrations • Implement business logic services: shareholder balance tracking, sharebook reconciliation, movement detection, classification rules • Maintain and extend Elasticsearch sync services (incremental and full resync workflows) • Support business stakeholders with data questions using the ELK stack — writing and running queries, interpreting results, and surfacing relevant data from Kibana • Parse and process structured financial data files (Excel, CSV) using Pandas, including data validation and deduplication • Write robust, type-safe Python following project standards (mypy strict mode, Black, isort) • Write and maintain automated tests with pytest — unit tests, repository mocks, snapshot tests • Collaborate with the CTO on data flow design and review migration strategies before deployment



