CI&T logo
CI&T

Navigate Change

AI Data Engineer, Mid-level

Data EngineerData EngineerFull TimeRemoteSeniorTeam 5,001-10,000Since 1995H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

110 days ago

Salary

0

Seniority

Senior

Bachelor DegreePortugueseAzurePySparkPythonSQLUnity

Job Description

AI Data Engineer, Mid-level

CI&T

• Design and implement GenAI-based solutions that optimize critical stages of the DDLC (Data Development Life Cycle). • Develop agents that act as assistants in creating Databricks notebooks, pipelines in ADF, and structures in Microsoft Fabric. • Create workflows that integrate LLMs into our ecosystem (SQL Server and Power BI), automating tasks such as data documentation and creation of DAX measures. • Apply advanced prompt engineering techniques to ensure the AI generates optimized, secure, and high-performance PySpark and T-SQL code. • Define quality metrics to validate AI-generated artifacts (e.g., ensure efficiency of generated queries). • Ensure solutions align with Data Governance, security, and privacy practices. • Stay up to date on AI capabilities within Microsoft Fabric and Databricks to maximize the use of native tools versus custom developments.

Job Requirements

  • Degree in Computer Science, Data Engineering, Statistics, or a related field.
  • Strong experience in Data Engineering and deep understanding of CI/CD pipelines applied to data.
  • Hands-on experience building GenAI solutions (OpenAI API, Azure OpenAI, or open-source models) with a strong focus on prompt engineering is essential.
  • Experience with AI agent orchestration frameworks (e.g., LangChain, Semantic Kernel, or AutoGen) is required.
  • Technical mastery of the Azure Data ecosystem (Databricks, Data Factory, and Fabric) and proficiency in SQL and Python/PySpark.
  • Ability to translate business challenges into agents that assist in data modeling and dashboard development.
  • DataOps mindset: understanding that data requires testing, versioning, and monitoring.
  • Deep knowledge of Microsoft Fabric and its AI integration capabilities.
  • Experience with Unity Catalog and data governance.
  • Knowledge of RAG (Retrieval-Augmented Generation) to build assistants that use internal technical documentation.
  • Azure Data Engineer or AI Engineer certifications.

Benefits

  • Health and dental insurance
  • Meal and grocery allowances
  • Childcare assistance
  • Extended parental leave
  • Partnerships with gyms and health & wellness professionals via Wellhub (Gympass/TotalPass)
  • Profit-sharing (PLR)
  • Life insurance
  • Continuous learning platform (CI&T University)
  • Discount club
  • Free online platform for physical and mental health and well-being
  • Prenatal and responsible parenting course
  • Partnerships with online course platforms
  • Language learning platform
  • And many more

Related Categories

Related Job Pages

More Data Engineer Jobs

Symbotic logo

Director, GCP Cloud Platform, Data Engineering

Symbotic

Reimagining robotics to reinvent the global supply chain

Data Engineer110 days ago
Full TimeRemoteTeam 501-1,000Since 2007H1B Sponsor

• Own the tenant modeling strategy, governing organization structure, resource isolation (compute/IAM), and automated provisioning. • Establish CI/CD standards, Cloud Run deployment automation, and release governance to ensure environment consistency. • Design enterprise-wide logging, tracing, and SLO-driven alerting standards to ensure production systems are diagnosable at scale. • Build multi-tenant data engineering frameworks using BigQuery, Cloud Composer/Airflow, and dbt (Medallion architecture). • Define cloud patterns for high-throughput Pub/Sub architectures and secure data sharing across shared platform services. • Prevent platform fragmentation by establishing global standards for onboarding, security, and cost optimization. • Direct a distributed team (including India-based GCC) to deliver architectural reviews and operational readiness across time zones.

United States
$181K - $248.6K / year
Job Closed
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Design, build, and maintain scalable data pipelines (ETL/ELT) and data models • Extract, transform, and load data from ERP, CRM, field service systems, and blob or database storage • Provide clean, well-structured, and documented datasets, including analytics-ready dbt models • Partner with analytics and business teams to ensure data is accessible, understandable, and fit for reporting and analysis • Assist with data integration for acquisitions • Support the data foundation required to track value creation initiatives and operational improvements • Implement data quality rules and operate within data governed environments.

Virginia
$130K - $160K / year
Job Closed
Full TimeRemoteTeam 51-200Since 2019H1B No Sponsor

• Define, evolve and ensure adoption of data architectures on Azure, aligned with business strategy and industry best practices • Act as a technical reference on complex initiatives, supporting architectural and technology decisions • Lead implementation of large-scale data solutions using services such as Azure Data Factory, Azure Databricks and Azure Synapse • Establish standards, frameworks and data engineering best practices, ensuring quality, governance and security • Design, build and optimize data pipelines with a focus on performance, scalability and operational efficiency • Drive modernization and migration initiatives for data platforms to the cloud • Collaborate with business, architecture, security and engineering teams to ensure integrated and sustainable solutions • Serve as a technical mentor, supporting squads and sharing knowledge across the team • Analyze and optimize costs, performance and cloud resource utilization, driving continuous improvements

Brazil
Job Closed
BJAK logo

Data Engineer

BJAK

Bjak is a technology company focused on making financial services easy, fun and more rewarding for everyone

Data Engineer110 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Design, build, and maintain scalable, fault-tolerant data pipelines (batch and/or streaming) for core business and product data. • Ingest data from diverse sources including APIs, databases, event streams, and third-party services, ensuring high data quality and reliability. • Design and manage data models and storage layers (data warehouses, data lakes) that support analytics and downstream use cases. • Partner with analytics, product, and engineering teams to deliver clean, well-documented datasets that enable self-service analytics and experimentation. • Implement monitoring, logging, and alerting to ensure pipeline reliability, performance, and cost efficiency. • Enforce data governance best practices, including access control, privacy, documentation, and data lineage.

Singapore
Job Closed