Data Engineer, AI
Location
Brazil
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer, AI
Cadastra
• Propose and build: Design modern architectural solutions (focus on Data Lakehouse) and rapidly test new technologies. • Develop: Create efficient data processes and pipelines (ETL/ELT) using industry best practices. • Automate and Orchestrate: Implement automations in Cloud environments (GCP, AWS, or Azure), ensuring high performance, security, and data governance. • Operate with a Product Mindset: Ensure the data platform is scalable, flexible, and oriented to serve business areas with structured data and AI models. • Facilitate and Translate: Act as a bridge between technical and business teams, translating complex engineering and AI concepts for stakeholders in a clear and educational manner. • Collaborate: Support colleagues and teams in adopting industry best practices, serving as a technical reference.
Job Requirements
- Strong Python skills: Essential for developing Data Engineering and AI solutions.
- Data Architecture: Solid experience with modern architectures, particularly Data Lakehouse.
- Cloud Computing: Hands-on experience with cloud platforms (AWS, Azure, or GCP), focusing on managed data and AI services.
- Orchestration and Pipelines: Experience with data orchestration tools (preferably Airflow).
- Data Handling: Strong SQL skills and experience with ETL/ELT processes (data extraction via APIs, cleansing, deduplication, aggregation, and anonymization).
- Best Practices: Experience with CI/CD (GitHub Actions / Cloud Build) and experience working in agile projects.
- Autonomy and Proactivity (Builder): Hands-on, curious, and independent profile, able to propose solutions and validate hypotheses quickly.
- Product Mindset: Ability to understand that the goal of engineering is not only the data but the product (data/AI) that addresses and solves other areas' needs.
- Communication and Collaboration: Excellent communication skills to translate the "alphabet soup" of AI engineering for business teams, ensuring alignment and engagement.
Benefits
- Meal and food allowance on FLASH card 🥗
- Home office stipend on FLASH card 💳
- Health insurance 🩺
- Dental insurance 🦷
- Birthday day off + an amount credited to the FLASH card 🎉
- Extended maternity and paternity leave 🍼
- Profit sharing (PLR) 💰
- Life insurance 🧡
- Childcare assistance 👶
- Referral bonus 💰
- Transport voucher 🚍
- Clude | Health platform 🩺
- TotalPass (fitness/wellness) 🏋🏽♀️
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Role Description We are looking for a Mid-to-Senior Data Engineer to architect, build, and operate cloud-native data pipelines on AWS. In this role, you will anchor the flow of data from diverse source systems—including relational databases, SaaS applications, and event streams—into a central Snowflake data platform modeled in dbt Cloud. You will be responsible for ensuring technical excellence across our data infrastructure by writing production-grade Python, utilizing modern AI coding assistants like GitHub Copilot and Claude, and managing infrastructure as code via Terraform. This role is critical to shaping and defending our core data architecture, optimizing platform performance, and delivering curated, analytics-ready datasets for downstream BI and reporting. As a key contributor on a fully remote team, your autonomy, ownership mindset, and clear written communication will directly impact our ability to scale data solutions and maintain full historical accuracy using advanced dimensional modeling techniques. Key Responsibilities - Design and own the architectural evolution of data pipelines and platform components, leading design reviews and defending technical decisions with evidence-based reasoning. - Build and maintain robust ingestion pipelines leveraging AWS DMS, Amazon AppFlow, and Amazon EventBridge to land data seamlessly into AWS S3 and Snowflake. - Optimize and model analytics datasets within dbt Cloud, applying strict dimensional modeling (Kimball techniques) and implementing SCD Type 2 logic. - Lead performance tuning and cost optimization efforts across the Snowflake ecosystem, proactively implementing monitoring, alerting, and root-cause analysis. - Collaborate with cross-functional teams to prepare curated datasets for Power BI, while mentoring peers through rigorous code reviews and engineering enablement. Qualifications - 5+ years of professional experience in Data Engineering roles. - Proficiency with Python (including AWS Lambda), advanced SQL, dbt Cloud, Snowflake, Terraform (IaC), and Docker. - Deep hands-on experience with core AWS data services (S3, Glue, Athena, EventBridge, AppFlow, DMS). - Solid grasp of dimensional modeling (star schemas, fact/dimension design) and practical implementation of SCD Type 2. - High autonomy, ownership mindset, discipline to raise risks early, and comfort utilizing AI-assisted development tools (GitHub Copilot, Claude). - Advanced English (written and spoken) is mandatory for seamless remote collaboration. Nice to Have - AWS Certified Data Engineer – Associate (DEA-C01) or equivalent certification. - Experience with change-data-capture (CDC) and near-real-time ingestion patterns. - Exposure to workflow orchestration tools such as Apache Airflow, Dagster, or Prefect. - Familiarity with data observability frameworks (Great Expectations, Monte Carlo) and open table formats like Apache Iceberg. Benefits - 100% Remote - Holidays off - Paid Time Off - Health insurance assistance - Competitive USD compensation - Growth opportunities
• Design, develop, maintain, and optimize data pipelines that support data integration, transformation, and analytics initiatives • Develop and maintain data models, data warehouses, and data structures that support reporting, business intelligence, and enterprise analytics • Extract, transform, validate, and load data from multiple source systems while ensuring data quality, integrity, consistency, and compliance with business requirements • Support the design, implementation, maintenance, and optimization of the organization’s data architecture and technology platforms • Develop, maintain, and optimize SQL queries, database objects, and data transformation processes to improve performance and scalability • Collaborate with Business Intelligence, Analytics, Technology, and business stakeholders to gather requirements and deliver data solutions that support business objectives • Support data quality initiatives by identifying, troubleshooting, and resolving data inconsistencies, duplicate records, and integration issues • Prepare and maintain technical documentation, data dictionaries, process documentation, and knowledge base resources to support ongoing operations and knowledge transfer • Communicate technical concepts, project updates, and data insights effectively to technical and non-technical stakeholders • Research and evaluate emerging technologies, tools, and best practices to improve data engineering capabilities and operational efficiency • Adhere to company policies and procedures • Meet or exceed performance targets for related KPIs • Continuously improve knowledge of products, services, and processes by participating in training programs and continuous learning modules • Collaborate with other departments as needed • Maintain a positive, empathetic, and professional attitude toward customers and colleagues at all times
• Build and maintain the data models and transformations that power reporting in the Skimmer product, leveraging tools like Fivetran transformations, dbt, and Sigma Computing materializations • Build and maintain customer-facing data models and reports in Sigma Computing, embedded within the Skimmer application • Manage and extend ingestion using Fivetran across a growing set of sources • Develop and maintain data transformations in Python and SQL against our Snowflake data warehouse • Partner with product and engineering to turn customer needs into reliable, performant reporting experiences • Collaborate with application engineers to understand source systems and ensure clean, reliable data capture • Monitor data quality, reliability, and report performance, and troubleshoot issues as they arise • Document data models, definitions, and architecture to support a growing team
Senior Data Engineer
McGraw Hill LLC.The work you do at McGraw Hill will be work that matters. We are collectively designing content that will build the future of education. Play your part and experience a sense of fulfilment that will inspire you to even greater heights.
Role Description As a Senior Data Engineer, you will be at the core of McGraw Hill’s data ecosystem designing, building, and optimizing scalable data solutions that power insights across finance, product, customer, and operational domains. You will work closely with analytics, product, and business stakeholders to translate complex requirements into reliable, high-performance data pipelines and architectures, helping teams make timely and informed decisions. - Design, develop, and maintain scalable data pipelines and solutions using AWS technologies - Build and optimize big data processing workflows using Databricks and Spark - Develop robust ETL/ELT solutions with parallel processing for faster and more efficient data delivery - Design and implement data models (facts, dimensions, star schemas, aggregations) to support reporting and analytics - Monitor and manage cloud-based data platforms to ensure performance, reliability, and SLA adherence - Translate business requirements into technical designs and end-to-end data solutions - Collaborate with cross-functional teams throughout the software development lifecycle, from requirements to deployment - Create and maintain high-quality technical and solution design documentation - Follow Agile/Kanban practices using tools such as Git and Jira Qualifications - A Bachelor’s degree in a related field or equivalent practical experience - 5+ years of experience in Data Engineering or a related discipline - Strong hands-on experience with AWS data services such as Athena, Glue, EMR, Lambda, and Iceberg - Proven experience working with Databricks and Spark-based data processing - Advanced proficiency in SQL and strong Python scripting skills - Solid understanding of modern data warehousing and data lake architectures - Experience with cloud infrastructure and infrastructure-as-code tools such as Terraform - Strong problem-solving skills, attention to detail, and ability to work independently - Excellent communication skills and the ability to collaborate with technical and non-technical stakeholders Requirements - Experience in the Education or Publishing domain (Nice to have) - Familiarity with analytics and BI tools such as Tableau or Microsoft Power BI (Nice to have) - Experience working with financial datasets (sales, revenue, COGS, manufacturing, etc.) (Nice to have) - Exposure to IBM Planning Analytics (TM1) (Nice to have) Benefits There has never been a better time to join McGraw Hill. In our culture of curiosity, collaboration, and innovation, you’ll have the opportunity to work on meaningful problems, own your growth, and help shape the future of learning through data and technology.



