• Design and implement scalable data models optimized for AI/ML use cases, ensuring data is structured for effective model training and inference • Architect and manage data pipelines using Databricks, including orchestration, job scheduling, and workflow optimization • Develop and maintain robust ETL/ELT processes to support data ingestion, transformation, and delivery across systems • Leverage Databricks Asset Bundles to manage deployment of data assets (pipelines, jobs, notebooks, and files) across environments • Collaborate with cross-functional teams to align data architecture with AI initiative requirements and business objectives • Ensure data quality, integrity, and governance standards are met across all pipelines and datasets • Contribute to CI/CD practices using Azure DevOps (ADO), with a future transition to GitHub-based workflows • Participate in Agile development processes, including sprint planning, stand-ups, and iterative delivery • Other duties as assigned

• Atue como Engenheiro de Dados Sênior DataStage em projetos estratégicos. • Liderando soluções de dados de alta complexidade em uma empresa de grande porte. • Na Selbetti, você será protagonista na construção de pipelines de dados robustos. • Apoiando decisões críticas de negócio e interagindo diretamente com clientes e times internacionais. • Liderar o levantamento de requisitos de dados junto ao cliente. • Realizar mapeamento, modelagem e integração de dados em DataStage. • Desenhar, desenvolver e otimizar jobs ETL complexos. • Conduzir testes, homologação e validação técnica com o cliente. • Garantir qualidade, performance e governança dos fluxos de dados. • Fazer o microgerenciamento das demandas e pendências do projeto. • Colaborar com equipes estrangeiras em inglês ou espanhol.

The projectYou'll work with our client, an American private equity and investment management firm – Fortune 500, based in New York. We support them in the area of infrastructure and data platform, and we build AI systems within that environment. The client works across finance, credit, investments, and real estate. Snowflake is the central data warehouse. Much of your work will start with data that already lives there and end with an AI-powered system the client's teams rely on. What you'll do - Design and ship LLM-powered applications: prompt pipelines, RAG, retrieval, evaluation. From validated proof of concept to production. - Deliver MCP servers that expose data and services to AI agents and applications. - Implement the security and authentication layer around them: enterprise authentication, custom IdP integrations, OAuth/OIDC flows. - Consume external APIs and wrap them into services – web services, traditional APIs, or basic UIs. - Integrate LLM providers (OpenAI and others) into client systems. - Build semantic search and retrieval on vector databases (Pinecone). - Query, process, and analyze data in Snowflake using SQL and Python. Prepare datasets that feed AI features and analytics. - Contribute to data pipelines when needed. Other team members own them day to day, so this stays occasional. - Document design decisions before implementation.

• Modeling datasets and schemes for consistency and easy access, • Design and implement data transformations and data marts, • Integrating third-party systems and external data sources into data warehouse, • Building data flows for fetching, aggregation and data modeling using batch pipelines.