Navigate Change
Senior Data Developer, Azure, Databricks
Location
Brazil
Posted
9 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Developer, Azure, Databricks
CI&T
• Develop, maintain, and improve data pipelines using Databricks, PySpark, Python, and SQL to transform raw financial data into reliable curated datasets. • Integrate new data sources into the existing data ecosystem, helping expand the platform’s capabilities and improve business visibility. • Support financial reconciliation activities, P&L routines, and global closing processes by ensuring data consistency, accuracy, and traceability across different sources. • Process large volumes of structured and semi-structured data, optimizing transformations, storage formats, and query performance using Delta Lake and Lakehouse best practices. • Monitor, troubleshoot, and support existing pipelines, identifying issues, investigating discrepancies, and ensuring reliable daily and monthly processing. • Propose and implement better technical approaches to improve performance, scalability, maintainability, and data quality across the financial data ecosystem. • Work closely with existing data engineers, business stakeholders, finance teams, and technology teams to understand needs and deliver high-quality data solutions. • Support data governance, validation rules, auditability, documentation, and controls to ensure trustworthy and well-managed financial data. • Support initiatives involving AI models and advanced data capabilities, helping integrate AI-driven insights and automation into data workflows.
Job Requirements
- Strong experience with Databricks, including notebooks, jobs, workflows, clusters, and best practices for building scalable data solutions.
- Proficiency in data processing using PySpark, Python, and SQL, with hands-on experience transforming raw data into curated and reliable datasets.
- Experience with Delta Lake and Lakehouse architecture, including Delta tables, incremental processing, data optimization, and structured data layers.
- Knowledge of Azure data ecosystem, especially Azure Data Lake Storage, data integration patterns, and cloud-based data processing.
- Experience supporting financial data pipelines, preferably involving reconciliation, P&L, financial closing, or other critical business processes.
- Hands-on experience maintaining and improving existing pipelines, including troubleshooting, performance tuning, documentation, and production support.
- Ability to work with structured and semi-structured data, ensuring data quality, traceability, and readiness for analytical and business consumption.
- Problem-solving mindset, with the ability to investigate complex data, understand root causes, and propose practical solutions in challenging data environments.
- Interest or experience with AI models and advanced data capabilities, supporting the integration of AI-driven solutions into data workflows.
- English proficiency for interaction with global teams, technical discussions, and documentation.
- Nice to Have:
- Familiarity with AI frameworks and methodologies.
- Experience with advanced capabilities, such as Delta Lake optimization, Databricks Workflows and Databricks Apps or Streamlit.
- Experience with data quality and observability practices, including validation rules, reconciliation checks, monitoring, logs, alerts, and pipeline execution metrics.
Benefits
- Health and dental insurance
- Meal and food allowance
- Childcare assistance
- Extended paternity leave
- Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
- Profit Sharing and Results Participation (PLR);
- Life insurance
- Continuous learning platform (CI&T University);
- Discount club
- Free online platform dedicated to physical, mental, and overall well-being
- Pregnancy and responsible parenting course
- Partnerships with online learning platforms
- Language learning platform
Related Guides
Related Job Pages
More Software Engineer Jobs
Senior Salesforce Developer, Data & AI
NeuraFlashDigital Transformation from point-of-sale to point-of-service with AI, Salesforce.com & Amazon Web Services 🚀
• Deliver the highest-quality, scalable, and AI-powered Salesforce solutions across the Salesforce, Data 360, and Agentforce platform. • Design and implement custom agentic and non-agentic solutions leveraging the breadth of the Salesforce and Data 360 programmatic capabilities such as Apex, JavaScript, Visualforce, Lightning Web Components, OmniStudio, and Business Rules Engine. • Design and build Data 360 solutions for the benefit of Generative AI, leveraging Unstructured DMOs, Retrievers, Search Indexes, and Document Processing, and becoming proficient in RAG best practices. • Collaborate with Data 360, AI, Architecture, and Project teams to translate requirements into effective technical solutions. • Build scalable and secure data solutions on Data 360—DLOs, DMOs, identity resolution, calculated insights, and real-time activation patterns. • Design and build integrations between Data 360, MuleSoft, enterprise data warehouses, and other systems using real-time and batch patterns. • Develop strategies to solve complex technical problems utilizing the full suite of Data 360 capabilities. • Explore and implement emerging AI capabilities, including GPT and LLM-driven use cases powered by unified customer data. • Stay current with Salesforce releases, Agentforce enhancements, and platform best practices, and acquire/maintain relevant Salesforce certifications. • Be a NeuraFlash evangelist in the Salesforce Community and help cultivate a company culture of success and fun. • Travel up to 25% for customer projects and company events.
Senior Salesforce Developer, Data & AI
NeuraFlashDigital Transformation from point-of-sale to point-of-service with AI, Salesforce.com & Amazon Web Services 🚀
• Deliver the highest-quality, scalable, and AI-powered Salesforce solutions across the Salesforce, Data 360, and Agentforce platform. • Design and implement custom agentic and non-agentic solutions leveraging the breadth of the Salesforce and Data 360 programmatic capabilities such as Apex, JavaScript, Visualforce, Lightning Web Components, OmniStudio, and Business Rules Engine. • Design and build Data 360 solutions for the benefit of Generative AI, leveraging Unstructured DMOs, Retrievers, Search Indexes, and Document Processing, and becoming proficient in RAG best practices. • Collaborate with Data 360, AI, Architecture, and Project teams to translate requirements into effective technical solutions. • Build scalable and secure data solutions on Data 360—DLOs, DMOs, identity resolution, calculated insights, and real-time activation patterns. • Design and build integrations between Data 360, MuleSoft, enterprise data warehouses, and other systems using real-time and batch patterns. • Develop strategies to solve complex technical problems utilizing the full suite of Data 360 capabilities. • Explore and implement emerging AI capabilities, including GPT and LLM-driven use cases powered by unified customer data. • Stay current with Salesforce releases, Agentforce enhancements, and platform best practices, and acquire/maintain relevant Salesforce certifications. • Be a NeuraFlash evangelist in the Salesforce Community and help cultivate a company culture of success and fun. • Travel up to 25% for customer projects and company events.
• Develop, maintain, and optimize stored procedures used in analytical processes and data integrations for BI systems. • Create high-performance SQL queries to support reports, KPIs, and management dashboards. • Implement and maintain ETL processes and data load routines. • Collaborate with BI and business teams to understand requirements and make data available for decision-making, analyzing scenarios and proposing technical solutions. • Analyze and resolve issues related to query and database process performance. • Ensure the quality, integrity, and consistency of data provided in analytical environments. • Support activities related to evolution, maintenance, incident resolution, and continuous improvement of database routines tied to the BI environment.
• Desenvolver, manter e otimizar stored procedures utilizadas em processos analíticos e integrações de dados para sistemas de BI. • Criar consultas SQL de alta performance para suporte a relatórios, indicadores e dashboards gerenciais. • Atuar na implementação e manutenção de processos ETL e rotinas de carga de dados. • Trabalhar em conjunto com equipes de BI e negócio para entendimento de requisitos e disponibilização de dados para tomada de decisão, analisando cenários e propondo soluções técnicas. • Realizar análise e correção de problemas relacionados à performance de consultas e processos de banco de dados. • Garantir qualidade, integridade e consistência das informações disponibilizadas nos ambientes analíticos. • Apoiar atividades de evolução, sustentação, resolução de problemas e melhoria contínua das rotinas de banco de dados relacionadas ao ambiente de BI.
