Helping people love where they live
Senior Data Engineer
Location
Brazil
Posted
5 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Grupo QuintoAndar
Role Description We are looking for a skilled and motivated Data Engineer Specialist to join our team. The responsibilities of this role is to design, build, and maintain a robust, self-service, scalable, and secure data platform and end-to-end data pipelines that empowers Data Analysts, and Data Scientists to deliver insights and drive strategic decision-making. Responsibilities of a Data Engineer at QuintoAndar: - Build and maintain a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation. - Create and edit data pipelines, considering business logic, choosing levels of aggregation, grouping and transforming fields, checking data quality, and cleaning the data. - Create data modeling and transformation workflows, enabling the creation of clear and accessible data abstractions. - Responsible for the entire code development lifecycle (monitoring deployment, documentation, performance, security, adding metrics and alarms, ensuring SLO budget compliance, and more). - Investigate inconsistencies and trace the source of differences (data troubleshooting). - Enable teams across the company to access and use data more effectively through self-service tools and well-modeled datasets. - Align with stakeholders to understand their primary needs while proposing extensible, scalable, and incremental solutions. - Conduct PoCs and benchmarks to determine the best tool for a given problem. - Contribute to defining the strategic vision, crossing team and service boundaries to solve problems. - Advocate for the value of data analytics and engineering within the organization and foster a data-driven culture. - Be a reference within the chapter on technical concepts, tools, and/or best coding practices. Qualifications - 7 or more years of experience in Data Engineering roles. - Specialist in technologies, solutions, and concepts of Big Data (Spark, Hadoop, Hive, MapReduce) and multiple languages (YAML, Python). - Experience with Airflow, Spark, AWS, and Databricks. - Strong foundation in software engineering principles, with experience working on data-centric systems. - Experience with columnar storage solutions and/or data lakehouse concepts. - Proficiency in Python or one of the main programming languages, with a passion for writing clean and maintainable code. - Strong knowledge in optimizing SQL query performance. - Experience in building multidimensional data models (Star and/or Snowflake schema). - Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc. - Knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others. - Proficiency in English - our code, documentation, tools, and materials are often structured in English. - Excellent communication skills, proactively sharing and collaborating with both technical and non-technical stakeholders. - Experience as a tech/project lead or similar. - Curiosity, detail-orientation, and thrive in a fast-paced, data-driven environment. Requirements - You will stand out if you have participated in building large-scale data platforms for big data sets and teams using Big Data technologies such as Spark, Trino, Hive, Atlas, Ranger, etc. - Experience in building semantic layers. Benefits - Competitive salary - Profit sharing - Meal allowance - Health insurance - Dental plan - Life insurance - Childcare subsidy and Atypical Parenthood subsidy - Wellhub - Home office allowance - Employee assistance program (mental health, social, legal, and financial support) - Extended parental leave - Day off on birthday, Mother’s Day, and Father’s Day - Benefits Club (discounts on everyday services) - Discounts at educational institutions - Reading kit for children – PlayKids
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Principal Data Engineer – Contractuel
NasstarFrom cloud optimisation and application modernisation to connectivity and collaboration, we are Nasstar.
• Vous servirez de passerelle entre une architecture technique complexe et la valeur commerciale stratégique. • Vous serez la principale autorité technique pour nos clients. • Agir en tant que partenaire stratégique principal auprès des responsables métiers clients. • Piloter le développement d'architectures de données complexes et à grande échelle. • Superviser les performances de livraison de plusieurs équipes. • Diriger le tri et la résolution des incidents critiques de la plateforme. • Mettre en œuvre des cadres de gouvernance robustes et des contrôles de conformité. • Promouvoir une culture organisationnelle de partage des connaissances. • Influencer la santé à long terme de l'organisation.
Associate Clinical Data Team Lead
Thermo Fisher ScientificThermo Fisher Scientific is a global biotechnology product development company whose mission is to make the world healthier, cleaner, and safer. Thermo Fisher Scientific leads a gl
Title: Assoc Clin Data Team Lead Location: Bangalore Karnātaka India Full time Reemote As part of our expert team, you’ll have the opportunity to ensure operational excellence that makes a real difference in organizational performance. As a Associate Clinical Data Team Lead, you will act as the assistant lead data manager for one or more projects, supporting the lead data manager by performing assigned tasks in study setup, data cleaning, database close-out, and other associated tasks. What You’ll Do: • Applies relevant components of the project protocol to daily tasks with guidance. • Delivers study specific training to junior associates for assigned projects. • Coordinates data cleaning tasks and delegates to appropriate data management staff to ensure quality standards are maintained and project deliverable timelines are met with minimal supervision. • Assists with specified activities that contribute to the creation of database specifications, database build and user acceptance testing during database and edit check development. • Monitors for risks to deadlines and escalates appropriately. • Creates and maintains data management project documentation. • Participates in team and client meetings and supports the lead data manager with risk management on allocated projects. • Provides input into project forecasting of hours and identification of resource requirements. • Monitors study metrics and runs project-specific status reports for management. • Reviews data management deliverables for allocated projects following documented guidelines. • Produces project-specific status reports for management, PM and/or clients on a regular basis Education and Experience Requirements: • Bachelor's degree or equivalent and relevant formal academic / vocational qualification • Previous experience that provides the knowledge, skills, and abilities to perform the job (comparable to 0 to 2 years). In some cases an equivalency, consisting of a combination of appropriate education, training and/or directly related experience, will be considered sufficient for an individual to meet the requirements of the role. Knowledge, Skills and Abilities: • Good written/ verbal communication skills with a strong command of English language and grammar; good organizational, analytical/problem solving skills and attention to detail • Ability to apply knowledge and skills in a highly organized fashion while adhering to regulatory guidelines, SOPs and client expectations • Ability to work productively with support and minimal supervision • Ability to maintain a high degree of confidentiality with clinical data and client's proprietary data • Strong customer focus and excellent interpersonal skills • Proven flexibility and adaptability • Ability to work in a team environment and independently as needed • Ability to train and direct junior team members • Ability to set and meet timelines or be able to recognize and schedule changes in response to project demands
Role Description At OZ we are looking for a Lead Data Engineer who will: - Serve as the technical lead for the project—owning solution design decisions, guiding implementation standards, and mentoring other engineers through coaching, reviews, and knowledge sharing. - Design, develop, and maintain complex ETL pipelines using Databricks, ensuring scalable, high-performance data integration across multiple source systems. - Implement and optimize medallion architecture within Databricks, establishing clear data zones (raw, curated, trusted) to support governed, enterprise-wide reporting. - Develop and refine dimensional data models that enable unified, analytics-ready views of business domains and support automated dashboarding and KPI frameworks. - Collaborate closely with cross-functional teams (data stewards, IT, business stakeholders) to translate operational requirements into technical solutions, proactively clarifying dependencies and driving alignment. - Contribute to architectural decisions, leveraging your expertise to recommend best practices, challenge assumptions, and ensure data platform durability and flexibility. - Identify and address integration challenges, data quality issues, and process bottlenecks early, providing actionable insights and thoughtfully pushing back when project risks or inefficiencies arise. - Support knowledge transfer and documentation, empowering colleagues and clients to maintain and evolve data solutions independently. Qualifications - Databricks Expertise: 3–5 years of hands-on experience developing in Databricks, with relevant certifications (attach proof). Proven ability to build, optimize, and troubleshoot production-grade ETL pipelines. - Medallion Architecture: Demonstrated experience designing and implementing medallion data models (raw, curated, trusted zones) in Databricks environments. - Dimensional Modeling: Strong skills in developing dimensional models to support business intelligence, reporting, and single source of truth requirements. - Complex ETL Development: Advanced proficiency in orchestrating data ingestion, transformation, and integration workflows across multiple systems and formats. - Business Acumen: Ability to understand operational requirements, translate them into technical deliverables, and communicate the business impact of engineering decisions. - Self-Starter: Demonstrated capacity to take initiative, work independently, and drive projects forward in ambiguous or evolving contexts. - Azure Ecosystem (Preferred): Experience with Azure Data Lake, Data Factory, and related services is a strong advantage but not required. - Data Visualization Design (Preferred): Experience with human centric design principles with data visualization tools such as Power BI, Qlik, or Tableau. - Clear Communication: Proactive, constructive communication skills with the confidence to provide feedback, challenge assumptions, and advocate for best practices. Requirements - Embrace OZ Digital’s values in daily work: adapting and learning, focusing on results, working collaboratively, maintaining a positive outlook, and leading with empathy. - Actively participate in a culture of mutual support, continuous improvement, and openness to new ideas. - Demonstrate the ability to provide insights and push back constructively when necessary, always with the goal of achieving the best outcomes for the team and project.
Senior Staff Engineer, Data Platform
ZocdocZocdoc is the beginning of a better healthcare experience for millions of patients every month.
• Architecting and improving orchestration, monitoring, and data reliability systems. • Defining modeling, semantic layer, and governance standards across teams. • Optimizing warehouse performance and reducing compute spend. • Implementing secure access controls and strengthening compliance practices. • Partnering with Engineering to improve upstream data quality and contracts. • Leading cross-functional initiatives that modernize and future-proof Zocdoc’s data platform. • Mentoring engineers and guiding architectural decisions.



