Luxury Presence logo
Luxury Presence

Luxury Presence works to provide stunning websites, world-class marketing services, and access to an exclusive network for some of the world’s leading real es

Senior Data Engineer

Location

United States

Posted

57 days ago

Salary

$150K - $190K / year

Seniority

Senior

Job Description

Senior Data Engineer

Luxury Presence

• Build and scale high-throughput streaming pipelines. Design, implement, and operate pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg—ensuring reliability, performance, and data correctness. • Model and deliver high-quality, production-grade real estate datasets. Develop and maintain datasets that power core product experiences, with a focus on data modeling, transformation logic, and balancing freshness, accuracy, and cost. • Strengthen data quality and observability. Implement and improve data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact. • Leverage AI to improve data operations. Contribute to AI-driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention.

Job Requirements

  • 6+ years of professional data engineering or software engineering experience
  • Strong experience with distributed data processing and streaming systems (Spark / PySpark, Kafka)
  • Proficiency in Python (Pydantic preferred) and familiarity with Node/TypeScript is a plus
  • Experience building and maintaining data pipelines on AWS using tools like Airflow, Spark Streaming, and Iceberg
  • Solid understanding of data modeling and working with large-scale datasets
  • Familiarity with event-driven systems and ingestion patterns (Kafka, SQS)
  • Experience implementing data quality checks, monitoring, and debugging data issues
  • Interest in applying AI/ML or automation to improve data workflows is a plus
  • Proven track record leading high-impact initiatives from concept through production in a SaaS environment
  • Expert-level grasp of software design principles and experience with multi-tenant platform architectures

Benefits

  • 401(K), Company equity, Company-sponsored outings, Customized development tracks, Dental insurance, Disability insurance, Diversity manifesto, Family medical leave, Flexible work schedule, Generous parental leave, Generous PTO, Health insurance, Job training & conferences, Open door policy, Life insurance, Charitable contribution matching, Mentorship program, Paid volunteer time, Paid holidays, Paid sick days, Onsite office parking, Partners with nonprofits, Performance bonus, Pet insurance, Promote from within, Lunch and learns, Free snacks and drinks, Team based strategic planning, OKR operational model, Mandated unconscious bias training, Unlimited vacation policy, Vision insurance, Wellness programs, Mental health benefits, Home-office stipend for remote employees, Diversity employee resource groups, Hiring practices that promote diversity, Fertility benefits, Employee resource groups, Hybrid work model, Personal development training, Flexible time off, Bereavement leave benefits

Related Categories

Related Job Pages

More Data Engineer Jobs

JobRad® Loop logo

Senior Data Engineer

JobRad® Loop

Wir geben Rädern eine zweite Chance.

Data Engineer57 days ago
Full TimeRemoteTeam 201-500Since 2018H1B No Sponsor

• develop scalable data architectures and take responsibility for business-critical pipelines • actively shape how data is used across the company • design, implement, and optimize high-performance data pipelines • strategically evolve our data architecture and ensure scalability and maintainability • act as an interface and work closely with business units and other affiliated companies • take technical ownership of our data landscape • evaluate and selectively implement new technologies

Germany
Tech6 Group logo

Junior Data Engineer

Tech6 Group

A Tech6 Group é uma empresa focada em soluções tecnológicas e inovação, conectando talentos a projetos desafiadores e de alto impacto, sempre com um olhar humano, colaborativo e voltado ao crescimento contínuo.

Data Engineer57 days ago

Role Description Sua principal missão será atuar na construção, transformação e organização de dados em diferentes camadas analíticas (Bronze, Silver e principalmente Gold), garantindo qualidade, consistência e disponibilidade das informações para consumo por times de BI e áreas de negócio. - Desenvolver e manter pipelines de ingestão e transformação de dados no Databricks - Estruturar e evoluir as camadas Bronze, Silver e Gold - Garantir qualidade, consistência e confiabilidade dos dados - Realizar tratamento, limpeza e padronização de dados - Apoiar na modelagem de dados para consumo analítico (dashboards e relatórios) - Monitorar execuções e atuar na correção de falhas em pipelines - Trabalhar em conjunto com times de BI e áreas de negócio - Documentar processos e fluxos de dados Qualifications - Conhecimento básico/intermediário em Python (pandas ou PySpark) - Experiência ou familiaridade com Databricks - Conhecimento em Spark (PySpark) - Conhecimento em SQL - Noções de modelagem de dados (dimensional ou relacional) - Entendimento básico de arquitetura de dados (Data Lake / Data Warehouse) - Experiência com manipulação de arquivos (CSV, JSON, Parquet) - Familiaridade com ambientes cloud (AWS, Azure ou GCP) Requirements - Experiência prévia com Databricks em ambiente produtivo - Conhecimento em Delta Lake - Experiência com ferramentas de orquestração (Airflow, etc.) - Conhecimento em Power BI ou outras ferramentas de visualização - Certificações em cloud (AWS, Azure ou GCP) - Experiência com versionamento de código (Git) - Noções de engenharia de dados moderna (medallion architecture, data quality, etc.) Benefits - Proatividade para aprender e evoluir tecnicamente - Capacidade analítica para resolução de problemas - Boa comunicação com áreas técnicas e de negócio - Organização e atenção a detalhes (dados “quase certos” ainda estão errados 😄) - Colaboração e trabalho em equipe - Curiosidade para entender o contexto dos dados Company Description A Tech6 Group é uma empresa focada em soluções tecnológicas e inovação, conectando talentos a projetos desafiadores e de alto impacto, sempre com um olhar humano, colaborativo e voltado ao crescimento contínuo.

Brazil
Job Closed
Full TimeRemoteTeam 51-200

En Flux IT diseñamos tecnología para empresas que quieren crecer, y lo hacemos desde una comunidad que se impulsa a mejorar cada día más. Somos más de 300 fluxers que hacemos equipo para acompañar la evolución digital de distintas industrias, como la bancaria, aseguradora, de salud y logística, desde Argentina, al resto de LATAM, EE. UU. e incluso Europa. Estamos buscando Data Engineers Sr. que quieran formar parte de nuestra #FluxITfam. ¿Te sumás? Tu modalidad de trabajo: - Full time. - 100% remoto, con oficinas a disposición en La Plata y Puerto Madero. Qué esperamos de vos: - Más de 4 años de experiencia trabajando en posiciones similares. - Experiencia sólida en Python, para la extracción y transformación de datos, y automatizaciones. - Conocimientos sólidos de SQL, para el diseño de tablas, consultas complejas y optimización (mejora de performance, análisis de planes de ejecución). - Conocimientos en bases de datos no relacionales (Mongo DB es un plus!). - Sólidos conocimientos en consumo de datos usando APIs REST. - Experiencia en Databricks. - Experiencia en la nube de Azure. - Experiencia en la nube de AWS, en particular con Redshift. Qué valoramos: - Estudiantes avanzados o egresados en Sistemas o carreras afines a datos. En Flux IT, tenemos un set de beneficios completísimo para acompañarte en tu día a día. Conocé algunos de los más valorados por nuestra comunidad: 🥳Días off: Disfrutá de 5 días de descanso extra al año para recargar energías. 🌴 Vacaciones flex: Customizá tus días libres para disfrutarlos de la manera que mejor se adapte a tus planes! 🎂 Día off de cumpleaños: Elegí qué día tomarte libre dentro del mes de tu cumple y disfrutalo de la manera que más te guste. 🛩️ Work from anywhere: Trabajá desde cualquier parte del mundo mientras explorás, viajás y seguís desarrollando tu carrera. 🍟 Fluxers a la mesa: Disfrutá de ser fluxer y volvé tus almuerzos más livianos con este beneficio ;) 💻 Crédito conectividad: Bancamos tus gastos de internet para que puedas trabajar desde la comodidad de tu casa. Y muuuuchos más! Entrá a www.fluxitsoft.com/cultura/ para conocer nuestra Flux IT Box completa. El bonus track? Somos el puesto #2 en Los Mejores Lugares para Trabajar en Tecnología según el ranking Great Place to Work® Argentina 🤩 ¿Qué esperás para llevar una vida fluxer?

Argentina
Authority Partners logo

Senior Data Engineer

Authority Partners

Authority Partners is a leading and global IT services company with over 26 years of experience, serving clients within the financial, healthcare, insurance, mortgage, and technology sectors among many others. We are committed to building relationships with IT professionals who possess integrity, dedication, teamwork, and the desire to learn and grow with us. We specialize in placement for long-term contracts and permanent opportunities and helping our consultants achieve their career success. Authority Partners is an equal opportunity employer and is committed to providing a workplace that is free from all types of discrimination, as well as from abusive or offensive behavior and harassment.

Data Engineer57 days ago

Role Description Authority Partners is seeking an experienced Data Engineer to join our team. You will design, expand, and optimize data pipelines and architectures to support cross-functional teams. The ideal candidate is skilled in building and enhancing data systems, supporting developers, analysts, and scientists, and ensuring seamless data delivery across projects. Responsibilities: - Design, build, and maintain reliable and scalable data pipelines for ingesting, transforming, and delivering structured and unstructured data. - Implement batch and streaming data workflows that support real-time and analytical use cases. - Optimize data flows for performance, cost-efficiency, and maintainability. - Develop and maintain data models that support business intelligence, analytics, and operational needs. - Ensure effective partitioning, indexing, and data lifecycle management strategies. - Collaborate with analysts and business stakeholders to understand data requirements and deliver high-quality datasets and data products. - Implement data quality checks, monitoring, and validation processes to ensure data accuracy and integrity. - Ensure compliance with relevant data governance, security, and privacy standards. - Monitor and troubleshoot data pipelines and systems to ensure reliability and high availability. - Design and develop interactive dashboards and reports that provide actionable insights to stakeholders, ensuring data is presented in a clear, intuitive, and visually compelling manner. Qualifications - Strong experience with Databricks for building scalable data pipelines and transformation workflows. - Hands-on experience with PySpark for distributed data processing. - Strong proficiency in SparkSQL for data transformation and analysis. - Solid understanding of data pipelines and data modelling. Requirements - Experience working with Azure cloud services. - Working knowledge of Databricks Dashboards. - Exposure to data visualization tools (Power BI, Tableau, Looker). - Experience with CI/CD pipelines for data engineering workflows. - Working knowledge of Microsoft Fabric and Dynamics 365 Finance and Operations. Education - Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. Company Description Authority Partners is a leading and global IT services company with over 25 years of experience, serving clients within the financial, healthcare, insurance, mortgage, and technology sectors among many others. We are committed to building relationships with IT professionals who possess integrity, dedication, teamwork, and the desire to learn and grow with us. We specialize in placement for long-term contracts and permanent opportunities and helping our consultants achieve their career success. Authority Partners is an equal opportunity employer and is committed to providing a workplace that is free from all types of discrimination, as well as from abusive or offensive behavior and harassment.

Worldwide