We deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.
Senior GenAI Data Engineer, Databricks
Location
Mexico
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Senior GenAI Data Engineer, Databricks
Enroute
• Architect AI Agents: Build and deploy agents that can perform NLP-based data generation, automated data enrichment, and complex data reasoning within Databricks. • Natural Language Interfaces: Develop "Chat with your Data" features, allowing stakeholders to query the data warehouse using natural language. • Integrate LLMs into data workflows for automation and intelligence • Develop scalable data models to support analytics and AI use cases • Implement AI-driven enhancements such as anomaly detection and data enrichment • Collaborate with data, analytics, and engineering teams to improve data reliability • Optimize performance and scalability of data and AI workflows • Support automation through CI/CD practices • Ensure data quality, traceability, and maintainability across pipelines
Job Requirements
- Databricks & AI Architecture (Must-Have)
- Strong experience working with Databricks Lakehouse architecture
- Nice to have expertise in Databricks Mosaic AI and Unity Catalog for governing AI assets
- Hands on experience Building RAG (Retrieval-Augmented Generation) pipelines using Vector Search
- SQL & Data Modeling (Must-Have)
- Advanced SQL development
- AI Engineering & Data Workflows (Must-Have)
- Experience integrating LLM APIs (OpenAI, Anthropic, etc.) into data workflows
- Hands-on experience using AI for:
- Data enrichment
- Anomaly detection
- Automated classification
- Experience with LangChain, LlamaIndex, or similar frameworks
- Exposure to Model Context Protocol (MCP) or similar approaches to connect AI models with external tools and data sources
- Strong understanding of Tool Calling / Function Calling: enabling LLMs to interact with SQL databases and external APIs securely.
- Experience in Prompt Engineering and Guardrailing: designing system prompts that maintain context and hierarchy (e.g., understanding team associations).
- Platform & Engineering Practices (Nice-to-Have / Medium)
- Experience with GitHub workflows
- Familiarity with CI/CD pipelines (Jenkins or similar)
- Experience working with YAML/YML configuration files
Benefits
- Monetary compensation
- Year-end Bonus
- IMSS, AFORE, INFONAVIT
- Major Medical Expenses Insurance
- Life Insurance
- Funeral Expenses Coverage
- TDU Membership
- MediAccess
- Health Check-Up Subsidy
- Preferential rates for car insurance
- Vacations
- Official Mexican Holidays
- Life Happens Days
- Bereavement Leave
- Civil Marriage Leave
- English Classes
- Certifications
- Educational Agreements (Talisis, U-ERRE, UNID, TecMilenio, Tec de Monterrey, UDEM, SPIS)
- Corporate Agreements & Discounts (Sorteos Tec, Envia Flores, TopGolf)
- Taquitos Rewards
- Birthday Bonus
- Work-from-home Bonus
- Laptop Policy
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Act as a technical advisor for the integration between Databricks and data privacy/governance tools. • Support the configuration of connectivity, access permissions, metadata, and security requirements within Databricks. • Guide and validate data discovery, classification, and scanning processes across the Data Lake. • Provide expertise on Databricks data structures, access patterns, and security models. • Collaborate with engineering and business teams to ensure data integrity, usability, and compliance. • Document data architectures, workflows, and technical processes. • Support troubleshooting and provide technical guidance on data-related challenges. • Contribute to Data Lake and Data Warehouse architecture discussions and best practices.
• Drive architectural strategy discussions with client leadership to ensure data platform initiatives align with business objectives and deliver measurable value • Act as the senior technical voice in client engagements, translating complex architectural decisions into business outcomes for both technical and executive audiences • Manage client relationships from an architectural perspective, building trust through technical excellence and strategic insight • Lead cross-functional teams of data engineers, data scientists, and analytics specialists in designing and deploying scalable, cloud-native data platforms • Support teams in planning and execution, providing architectural guidance and removing technical blockers throughout the delivery lifecycle • Mentor team members on cloud architecture best practices, data modeling principles, and emerging technologies • Design and implement robust AWS-based data lake architectures using Medallion (Bronze/Silver/Gold) patterns, managing trade-offs in storage strategies, partitioning schemes, and schema evolution • Lead the transition of legacy data structures and systems to modern cloud platforms, developing migration strategies that minimize risk and maximize business continuity • Architect solutions that balance performance, cost, scalability, and maintainability across complex data ecosystems • Partner with Data & Analytics Managers and business stakeholders to translate business requirements into feasible, scalable architectural decisions • Define data models, integration patterns, and platform capabilities that directly support business use cases and analytics needs • Navigate complex, siloed data landscapes to design practical solutions that deliver value incrementally • Design data platforms that natively support AI and ML workloads, including feature engineering pipelines, feature stores, model training data preparation, and inference serving infrastructure • Architect MLOps capabilities as a core platform component, not an afterthought, ensuring seamless integration of machine learning lifecycle management • Implement solutions leveraging agentic AI technologies to optimize data management, automate data quality workflows, and enhance analytics capabilities • Advise on governance models (centralized vs. federated) appropriate to organizational structure and data maturity • Implement Data Mesh principles to enable domain-oriented ownership while maintaining platform-level standards and interoperability • Define data quality frameworks, metadata management strategies, and security/privacy controls that scale across distributed architectures • Integrate AI tools and methodologies into daily architectural work, demonstrating innovative approaches to design, documentation, and problem-solving • Stay current with emerging data and AI technologies, evaluating their applicability to client challenges and incorporating them into platform strategies
• Serve as a trusted technical advisor for clients, bridging business strategy and cloud architecture • Lead the design and implementation of cloud-native data architectures with an emphasis on AWS solutions • Manage client relationships, building trust through technical excellence and strategic insight • Lead cross-functional teams in designing and deploying scalable, cloud-native data platforms • Support teams during execution, providing architectural guidance and removing blockers • Mentor team members on cloud architecture best practices and technologies • Design and implement robust AWS-based data lake architectures • Transition legacy data systems to modern cloud platforms, developing migration strategies • Partner with stakeholders to translate business requirements into architectural decisions • Design platforms that support AI/ML workloads and integrate AI tools into architectural work
• Design, build, and operate data pipelines that process terabytes of transactional data daily using Airflow/Composer and BigQuery • Own end-to-end data models and transformations that power merchant analytics, operational reporting, and ML features • Build and maintain embedded analytics infrastructure — the data products our merchants interact with directly • Evolve our data platform on GCP, including BigQuery, Cloud SQL, AlloyDB, and CDC datastreams • Improve data quality and reliability through testing, observability, alerting, and validation frameworks • Own data lineage, metadata, and documentation, and help prepare our data layer for agentic and LLM-powered use cases with semantic clarity and standardized metric definitions • Collaborate cross-functionally with product, ML, and GTM teams, and contribute to technical direction through design docs and architecture decisions


