Navigate Change
Senior Data Engineer – Generative AI, Data and MDM
Location
Brazil
Posted
3 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Generative AI, Data and MDM
CI&T
• Develop, optimize and maintain scalable data pipelines using Databricks, Spark and PySpark. • Work on integration, transformation, cleansing and provisioning of large-scale master/customer data. • Build and maintain cloud-based Big Data products, ensuring scalability, performance, reliability and data quality. • Work with customer master data domain, supporting initiatives related to Golden Record, data quality, governance and MDM. • Design and implement data solutions that support intelligent systems based on Generative AI, agents and multi-agent systems. • Prepare, structure and provision data for consumption by Machine Learning models, LLMs, autonomous agents and intelligent workflows. • Support the construction of agents and multi-agent systems capable of analyzing customer master data at scale. • Help identify patterns, inconsistencies, gaps, duplicates, anomalies and opportunities for improvement in master/customer data. • Develop data mechanisms for generating alerts, explainable recommendations and decision support. • Apply Analytics and Machine Learning techniques for anomaly detection, classification, clustering and scoring of master/customer data. • Support strategies for data qualification, enrichment, prioritization and governance. • Use Generative AI to support the generation, evolution, validation and explanation of business rules. • Explore and support implementation of architectures such as RAG, autonomous agents, multi-agent systems and intelligent workflows. • Work with near real-time data processing using Kafka. • Support the productionization of Machine Learning models on Databricks, applying MLOps concepts. • Create, maintain and evolve CI/CD pipelines using GitHub and GitHub Actions. • Ensure development best practices, ensuring solutions follow standards of quality, efficiency, maintainability and governance. • Optimize the use of available data to maximize its value for business and technology areas. • Collaborate with MDM, Data, Technology and Business teams to ensure developed solutions are measurable, governable and applicable. • Support technical and functional refinements, ensuring clarity, feasibility and alignment of stories to project needs. • Help create clear, well-defined and technically feasible user stories. • Participate in AS-IS and TO-BE design, documenting current and future processes, identifying technical debt, risks and opportunities for improvement. • Develop refined and approved stories, ensuring quality, efficiency and adherence to technical standards. • Identify technical debt and propose continuous improvements in architecture, processes, data and solutions. • Work in partnership with data and business focal points to ensure alignment between technical solutions, best practices and strategic needs.
Job Requirements
- Strong experience as a Data Engineer, Senior Data Engineer or equivalent role.
- Strong proficiency in Python for data engineering, automation, data analysis and supporting AI solutions.
- Solid knowledge of SQL and exploration of structured data.
- Experience with Databricks, PySpark and Spark.
- Experience building, optimizing and maintaining scalable data pipelines.
- Experience in cloud environments, preferably Azure Databricks and GCP.
- Knowledge or experience with Gemini to support GenAI solutions.
- Knowledge of Generative AI, LLMs and data-driven intelligent applications.
- Knowledge of agent architectures, multi-agent systems and autonomous systems.
- Experience with RAG, intelligent workflows, data-driven recommendation and cognitive automation.
- Experience with applied Machine Learning techniques, including anomaly detection, classification, clustering and scoring.
- Experience with near real-time data processing, preferably with Kafka.
- Experience with productionizing Machine Learning models on Databricks and MLOps practices.
- Experience with CI/CD pipelines, especially GitHub and GitHub Actions.
- Mastery of data engineering best practices, versioning, testing, code review and data quality.
- Knowledge of programming logic, application development and performance optimization.
- Ability to translate business problems into data, analytical and intelligent solutions.
- Experience working in agile squads and agile methodologies.
Benefits
- Health and dental insurance;
- Meal and grocery allowances;
- Childcare assistance;
- Extended parental leave;
- Partnership with gyms and health & wellness professionals via Wellhub (Gympass) TotalPass;
- Profit Sharing (PLR);
- Life insurance;
- Continuous learning platform (CI&T University);
- Discount club;
- Free online platform dedicated to physical and mental health and wellbeing;
- Pregnancy and responsible parenting course;
- Partnerships with online course platforms;
- Language learning platform;
- And many others
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Energy Engineer Development Lead
CEG SolutionsCEG Solutions is an equal opportunity employer committed to diversity, equity, inclusion, mentorship, and professional development. We foster a collaborative, non-hierarchical environment where creativity, technical excellence, and teamwork drive results — and where every team member has the opportunity to grow. CEG Solutions — Shaping the Future of Sustainable Energy. Join Us.
Role Description CEG Solutions is hiring an Energy Engineering Discipline Lead to provide senior technical leadership for our energy engineering practice. This role will impact how CEG identifies, develops, and delivers energy conservation measures (ECMs) across our portfolio of projects. This is a leadership role for an engineer who combines deep expertise in energy modeling and analysis with the drive to build a best-in-class energy analysis discipline. This role will improve methodology, raise quality, mentor engineers, and advance how the team applies technology and AI in its analytical workflows. You'll be the technical anchor for our energy engineering team: - Providing QA/QC oversight on models and savings calculations. - Refining analytical methodologies. - Developing new modeling techniques. - Overseeing how we integrate AI tools and automation into the practice. MEP design experience is a strong plus — it strengthens the ability to ensure that the measures we develop are not only well-modeled but also constructible and well-coordinated with mechanical, electrical, and plumbing systems. Qualifications - B.S. in Mechanical Engineering, Architectural Engineering, or related field (M.S. preferred). - 10+ years of progressive experience in building energy systems, energy modeling, and ECM savings calculations. - Active Professional Engineer (PE) license in any U.S. state required; LEED AP or CEM certification a plus. - Deep expertise in energy modeling tools and/or simulation platforms. - Demonstrated experience leading or mentoring engineering teams. - MEP design experience preferred — particularly mechanical systems design for commercial, institutional, or industrial facilities. - Experience with energy performance contracting (ESPC), guaranteed savings projects, or design-build delivery preferred. - A genuine interest in applying AI tools and automation to engineering workflows. - Drug and background screening required. Requirements - Serve as the primary technical authority on energy modeling, ECM calculations, and energy analysis across the firm's project portfolio. - Refine the standards, methodologies, and tools used by the energy engineering team. - Lead the development and continuous improvement of energy modeling approaches, tools, and calculation methodologies. - Identify gaps in current modeling practice and create new methods, spreadsheets, simulation approaches, or analytical frameworks to close them. - Oversee the integration of AI tools, automation, and technology-enabled workflows into the energy engineering practice. - Provide direct mentorship and technical guidance to energy engineers at all experience levels. - Help design and maintain training resources and a standard playbook for new engineers. - Develop and implement standardized procedures governing the full modeling lifecycle. - Provide QA/QC oversight across active projects. Benefits - Strategic influence: A direct voice in shaping the energy engineering discipline and CEG's long-term technical direction. - Authority to elevate the practice: Real ownership over modeling methodology, QA/QC, training, and team growth. - Interesting, critical work: Hands-on engagement with high-complexity, mission-critical facilities. - A leadership path: Room to grow as the energy engineering discipline and business needs and opportunities grow. - AI-enabled innovation: A platform to oversee the practical application of AI and automation in engineering workflows. Company Description CEG Solutions is an equal opportunity employer committed to diversity, equity, inclusion, mentorship, and professional development. We foster a collaborative, non-hierarchical environment where creativity, technical excellence, and teamwork drive results — and where every team member has the opportunity to grow. CEG Solutions — Shaping the Future of Sustainable Energy. Join Us.
Project Engineer – Team Lead
Crystalia Glass LLCCrystalia Glass was founded in 2017 and began developing and selling innovative glazing systems.
• Operational Management: Daily review of active projects in ClickUp, distributing workloads, monitoring task execution, and tracking strict project deadlines. • Quality Assurance & Review: Controlling drawing quality, checking project documentation, and ensuring compliance before final delivery. • Technical Mentorship: Mentoring project engineers on complex/non-standard projects, participating in node development, and leading daily/weekly team syncs. • Process Standardization: Customizing and maintaining workspaces in Slack/ClickUp, building internal document templates, and updating working groups. • Reporting: Preparing weekly and monthly progress and efficiency reports of the department for the Head of Engineering. • Working with measurements, sketches, and diagrams (Imperial system) USA.
Role Description Take ownership of software tooling and configuration management software and infrastructure. Maintain and improve reliability of production services by developing innovative monitoring and scaling solutions to measure system health and automate resilience. - Migrate legacy Jboss EJB applications to Spring boot applications. - Migrate ELK and On-premises repository managers to AWS cloud-based applications platforms. - Continuously improve hybrid, on-premises, and cloud infrastructure to support development throughout the full-service lifecycle. - Develop automated bots to gather system performances and metrics. - Analyze and optimize applications for performance. - Support teams across the organization with connectivity configuration and file delivery automation. - Provide second level support for incident management across the brokerage system and create corrective action. Telecommuting Permissible. Qualifications - Master’s degree or foreign equivalent in Computer Science, Information Systems or related field. - 3 years of experience as a Software Engineer or related IT position. Requirements - 3 years of experience with JBoss; Vertx; Tomcat; ActiveMQ; Spring application servers and their integration with Apache and Nginx web server. - 3 years of experience with Unix and Shell scripting. - 3 years of experience migrating legacy applications from on-premises to AWS and Google Cloud. - 3 years of experience with Git; Ant; Maven; Ivy; Nexus; and Junit. - 3 years of experience with Jenkins for continuous build, deployment and integration testing. - 3 years of experience with JVM Performance monitoring using jconsole, and jstack. - 2 years of experience creating automation bots. - 2 years of experience working with LLM. Benefits - Competitive salary, annual performance-based bonus and stock grant. - Retirement plan 401(k) with competitive company match. - Excellent health and welfare benefits, including medical, dental, and vision benefits. - Wellness screenings and assessments, health coaches and counseling services through an Employee Assistance Program (EAP). - Paid time off and a generous parental leave policy. - Daily company lunch allowance provided and a fully stocked kitchen with healthy options for breakfast and snack. - Corporate events including team outings, dinners, volunteer activities and company sports teams. - Education reimbursement and learning opportunities. - Modern offices with multi-monitor setups.
F5 Engineer – BIG-IP rSeries Migration
C-ServTech Talent Solutions | Building High-Impact Teams Worldwide
A short, high-impact 21-day contract for an experienced F5 engineer ready to own a full platform migration from legacy i5800 appliances to the rSeries r5600 platform. The engagement is due to commence at the end of August and is expected to be outside IR35. Our client is migrating four F5 BIG-IP appliances across two data centres, transitioning vCMP guest configurations to F5OS tenants. The environment runs BIG-IP v17.1+ across HA pairs provisioned with LTM, DNS, APM, and ASM. This is a like-for-like migration with a clear scope, structured cutover windows, and a well-defined architecture. The equipment is procured and the project is ready for execution. __**What You'll Own**__ End-to-end delivery across seven phases: **Planning & Preparation:** Review the existing F5 configuration (including QKView analysis), identify migration risks, and produce the migration plan, runbook with rollback steps, and testing plan for stakeholder sign-off. **Platform Setup:** Prepare UCS files, establish management access on the r5600 devices, activate F5 cloud licensing, upgrade F5OS, create BIG-IP tenants, and provision all modules. Import and adapt the base configuration offline to ensure zero production impact. Configure HA failover, SYSLOG/SNMP monitoring, and remote authentication (LDAP/AD/TACACS/RADIUS). **Component Testing:** Execute cold testing, cold commissioning, and hot failover testing on each HA pair. Produce test evidence for customer witness sign-off. **Configuration Migration:** Like-for-like migration of LTM, ASM, and APM configurations. Integrate new DNS BIG-IPs into the existing sync-group. Validate connectivity, pool member availability, application monitoring, and licensing. **Cutover:** Lead two out-of-hours change windows (4 hours each, one per DC), including failover, verification, and post-cutover testing. **Post-Cutover Support:** Up to 4 hours of next-business-day support after each cutover. **Knowledge Transfer:** Deliver a 4-hour session covering operations, administration, backup/restore, and troubleshooting. Update the As-Built documentation to reflect the migrated deployment.


