Job Closed

This listing is no longer active.

Senior Data Engineer, Databricks

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+H1B SponsorCompany SiteLinkedIn

Location

Brazil

Posted

75 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer, Databricks

Compass

• Maintain, organize, and evolve the data structures of the Security and Fraud platform; • Develop integrations and data pipelines using Python and PySpark in a Databricks environment; • Work in partnership with business areas, translating requirements into reliable SQL queries for the promotional platform; • Maintain and support legacy systems (ODI and Teradata); • Ensure data quality, governance, and security, taking a proactive approach to identifying and resolving inconsistencies.

Job Requirements

  • Experience with advanced SQL for data analysis and provisioning;
  • Strong experience with Databricks (Delta Lake, notebooks, jobs, and performance optimization);
  • Proficiency in Python and PySpark for building data pipelines;
  • Knowledge of data modeling (dimensional, relational);
  • Experience with MLOps practices (versioning, deployment, monitoring, and model governance);
  • Knowledge of data architecture and best practices (quality, lineage, and observability);
  • Experience with legacy environments (Teradata, ODI);
  • Plus: Experience in fraud prevention/detection projects.

Related Categories

Related Job Pages

More Data Engineer Jobs

People Inc. logo

Data Engineering Intern

People Inc.

People Inc. is the largest print and digital publisher in America. Nearly 200 million people trust us each month to help them make decisions, take action, and find inspiration. People Inc.'s over 40 iconic brands include PEOPLE, Better Homes & Gardens, Verywell, Food & Wine, Travel + Leisure, Allrecipes, REAL SIMPLE, Investopedia, and Southern Living. Please be aware of fraudulent recruiters offering opportunities at People Inc. If you are in conversations about a job opportunity and wish to confirm its validity, please reach out directly to hrconcerns@people.inc.

Data Engineer75 days ago
InternshipRemoteTeam 1,001-5,000Since 1996

Job Title Data Engineering Intern Job Description The People Inc. Internship will start June 2026 and end May 2027. About People Inc: People Inc. is America’s largest digital and print publisher. Our 40+ iconic and fast-growing brands harness the best intent-driven content, the fastest sites, and the fewest ads to help nearly 200 million people every month, including 95 percent of US women, make decisions, take action, and find inspiration. People Inc. brands include PEOPLE, Better Homes & Gardens, Verywell, FOOD & WINE, The Spruce, Allrecipes, Byrdie, REAL SIMPLE, Investopedia, Southern Living and more. About Your Team: Our team includes Data Engineers, Analytics Engineers, and people who simply enjoy working with data. Many of us arrived here through different paths—engineering, analytics, research, and beyond—but we share a common curiosity about data and a commitment to building systems that help others trust and use it. About the Intern Role: We are looking for a motivated Data Engineering Intern to join our data team and help build and maintain reliable data pipelines that power analytics and decision-making across the organization. In this role, you will gain hands-on experience working with modern data tools and cloud platforms while collaborating with experienced data engineers and analysts. This internship is designed to provide exposure to real-world data engineering practices, including data modeling, pipeline orchestration, and data quality. You will have the opportunity to contribute to production systems and learn how scalable data platforms are built and maintained. Internship Responsibilities will Include: - Assisting in the development and maintenance of data pipelines and ETL/ELT workflows - Writing SQL queries to transform, validate, and analyze data - Supporting the design and implementation of data models used for analytics and reporting - Monitoring pipeline performance and helping troubleshoot data issues - Working with orchestration tools to schedule and manage data workflow - Documenting data pipelines, datasets, and engineering processes - Collaborating with data engineers, analysts, and other stakeholders on data initiatives About You: You are curious about how data systems work and excited to learn how large datasets are processed and transformed into meaningful insights. You enjoy solving problems, writing code, and learning new technologies. You are comfortable asking questions, collaborating with others, and taking ownership of tasks as you grow your technical skills. Candidates for this role should have: - Basic experience with SQL and data analysis concepts - Familiarity with Python or another programming language - Understanding of basic data structures and software development practice - Interest in data pipelines, data warehouses, and distributed systems - Strong problem-solving and communication skills - Ability to work independently and collaboratively in a team environment It is the policy of People Inc. to provide employment opportunities regardless of age, physical or mental disability, race, gender, sex, sexual orientation, or any other characteristic protected by applicable laws. In addition, the Company will provide reasonable accommodations for qualified individuals with disabilities. Accommodation requests can be made by emailing hr@people.inc. #NMG#

Canada
Job Closed
Full TimeRemoteTeam 501-1,000Since 2014H1B No Sponsor

• Partner with business owners to cultivate a shared vision for the problem space, constraints, priorities and ideal end state, and be able to articulate and advocate for this perspective. • Ongoing optimization of live user workflows and capabilities including monitoring of key metrics & internal user feedback. • Work with internal teams and end users to develop a deep understanding of requirements, perform thoughtful technical solution designs, use data to test hypotheses, and support teams throughout execution. • Write detailed user stories for new features, capturing detailed descriptions of business rationale, requirements, and success criteria that are defined by measurable outcomes. • Develop short- and long-term roadmaps that deliver maximum value with minimum risk and assume ongoing iteration.

United States
Enroute logo

AI Engineer, Data Engineer

Enroute

We deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.

Data Engineer75 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Design and build AI-powered data pipelines within Databricks • Integrate LLMs into data workflows for automation and intelligence • Develop scalable data models to support analytics and AI use cases • Implement AI-driven enhancements such as anomaly detection and data enrichment • Collaborate with data, analytics, and engineering teams to improve data reliability • Optimize performance and scalability of data and AI workflows • Support automation through CI/CD practices • Ensure data quality, traceability, and maintainability across pipelines

Mexico
Job Closed
Indian Importers Chambers of Commerce and Industry logo

Data Engineer

Indian Importers Chambers of Commerce and Industry

Indian Importers Chambers of Commerce and Industries is a Non-Profitable All India Body

Data Engineer75 days ago
ContractRemoteTeam 11-50H1B No Sponsor

• Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from various sources • Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions • Optimize and tune database queries and processes for performance and efficiency • Implement data quality checks and validation procedures to ensure the integrity and accuracy of data • Build and maintain data warehouses and data marts to support reporting and analytics needs • Work closely with data scientists and analysts to provide access to structured and unstructured data for analysis and modeling • Continuously evaluate and adopt new technologies and tools to enhance data processing capabilities and improve efficiency • Document technical designs, processes, and procedures for data engineering projects • Troubleshoot and resolve issues related to data pipelines, databases, and data infrastructure • Stay up-to-date with industry trends and best practices in data engineering and related technologies

India