A Tecnologia do Grupo Casas Bahia - A dedicação nunca foi tão forte!
Data Engineering Specialist – Data Platform
Location
Brazil
Posted
26 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineering Specialist – Data Platform
Casas Bahia Tecnologia
• Design and develop the next generation of the company's data ingestion platform. • Define and evolve an AI-driven data ingestion architecture. • Build and maintain intelligent (ETL/ELT) ingestion pipelines that are scalable, reusable and resilient. • Incorporate AI agents for automation, orchestration and intelligent data validation. • Develop solutions based on RAG (Retrieval-Augmented Generation), embeddings and vector search. • Integrate multiple data sources: APIs, databases, events, SaaS and files (structured and unstructured). • Work with large-scale batch and streaming data processing. • Ensure data quality, reliability, governance and observability. • Apply anomaly detection techniques and intelligent pipeline validation. • Automate data integration and operations processes. • Establish best practices, standards and guidelines for data ingestion and Data Platforms. • Collaborate closely with Engineering, Analytics, Data Science, Product and Business teams. • Deliver high-impact business solutions with technical autonomy and ownership.
Job Requirements
- Strong experience with Databricks (Jobs, Clusters, Unity Catalog).
- Solid experience building data ingestion pipelines (ETL/ELT).
- Experience with distributed processing (Spark) for both batch and streaming (Kafka, Spark Streaming, etc.).
- Experience with cloud platforms (AWS, Azure or GCP).
- Familiarity with workflow orchestrators (Airflow, Dagster or similar).
- Hands-on experience developing AI agents or RAG-based systems.
- Knowledge of LLMs (Large Language Models) and frameworks such as LangChain, LlamaIndex.
- Experience with embeddings, vector search and semantic processing.
- Experience with Agent Frameworks (e.g., LangGraph, CrewAI).
- Experience working with unstructured data (PDFs, documents, HTML, logs, etc.).
- Knowledge of SQL and NoSQL databases and data modeling.
- Familiarity with data governance practices (catalog, lineage, security).
- Critical thinking, autonomy and the ability to solve complex problems creatively.
- Excellent communication, technical influence and sense of responsibility.
- It would be great if you have:**
- Experience building internal data platforms (Internal Data Platforms) focused on automation and self-service.
- Experience with DataOps practices and data observability.
- Knowledge of Infrastructure as Code (e.g., Terraform).
- Certifications in Data Engineering, Analytics Engineering or AI Engineering.
Benefits
- Profit Sharing/Bonus: Additional recognition to reward your effort and dedication! 💸
- Health and Dental Insurance: To ensure security and care for you and your family. 🏥
- Meal Allowance: Because we know good food is essential for your day! 🍽️
- Life Insurance: Peace of mind and protection for you and your loved ones. 🛡️
- Extended Maternity Leave: 180 days for our mothers to enjoy this special time with their baby! 👶
- Extended Paternity Leave: 20 days so fathers can also be present in the early days of life. 👨👩👧👦
- Fitness Incentive: Access Wellhub (Gympass) and Total Pass to stay active and healthy. 🏋️♂️
- Transportation Allowance: To ensure your commute to work is smooth and worry-free. 🚆
- Agreement with SESC: Enjoy great benefits in culture, leisure, health and more! 🎭
- Discount Club: Savings up to 70% on products and services with over 2,000 partners across Brazil and Latin America! 🛍️
- Birthday Day-Off: Celebrate your day with extra rest and fun—you get a day off on your birthday! 🎉
- Pharmacy Discounts: Exclusive discounts on medications to help you save on healthcare! 💊
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Diseñar, desarrollar y mantener canales de datos y procesos ETL para garantizar el flujo eficiente y confiable de datos desde diversas fuentes a nuestro almacén de datos. • Colaborar con científicos de datos, analistas y otras partes interesadas para comprender los requisitos de datos y traducirlos en soluciones técnicas. • Realizar modelado de datos y diseño de bases de datos para optimizar el almacenamiento y la recuperación de datos. • Implementar procesos de validación y calidad de los datos para garantizar la precisión e integridad de los datos. • Supervisar y solucionar problemas de sistemas y canalizaciones de datos para identificar y resolver cualquier problema o cuello de botella. • Desarrollar y mantener documentación para procesos, sistemas y mejores prácticas de ingeniería de datos. • Manténgase actualizado con las últimas tendencias y tecnologías en ingeniería de datos y recomiende mejoras para mejorar la infraestructura y los sistemas de datos.
Associate Engineer – Data Platform
Defense UnicornsWe help mission-focused heroes solve the world’s biggest software challenges.
• Write and maintain test suites — integration, end-to-end, and regression • Write automated tests and test documentation that any engineer can reproduce and act on • Package and deploy open source software components in Kubernetes environments • Build and maintain seed data tooling and scripts that make the platform demonstrable from scratch • Contribute to internal tooling, dashboards, and documentation • Write clear bug reports and reproduction steps • Participate actively in code review, seeking feedback, and growing your technical judgment
Senior Data Engineer – Flexibility
gridXBuild, roll out and scale future-proof solutions for home energy management and e-mobility faster and more effectively.
• Shape the Future of Energy: You build and optimize data products that intelligently connect and orchestrate millions of decentralized energy resources worldwide. • Develop Advanced Data Workflows: You design and implement scalable clustering and forecasting workflows based on asset measurements and complex time-series data. • Empower Energy Trading: You deliver the precise evaluations and predictions necessary for high-stakes decision-making and trading on the wholesale energy market. • Solve Scalability Challenges: You apply solid engineering and creative problem-solving to ensure millions of individual assets work together in perfect concert. • Drive Sustainable Impact: You collaborate with a growing team to deliver high-quality, impactful solutions that accelerate the global transition to a fully renewable energy system.
• Design, implement, and maintain scalable data pipelines using Snowflake, Coalesce.io, Airbyte, and SQL Server/SSIS, with some use of Azure Data Factory • Build and maintain dimensional data models to ensure high-quality, structured data for analytics and reporting • Implement Medallion architecture in Snowflake, managing bronze, silver, and gold layers • Collaborate with teams using Jira for task tracking and GitHub for code repository management • Ensure reliable ETL processes, data transformations, and data integration workflows • Help improve data modeling practices and address weaknesses in dimensional modeling
