Conectando Talento y Tecnología
Ingeniero de Datos, Cloud Native
Location
Mexico
Posted
7 days ago
Salary
0
Seniority
Senior
Job Description
Ingeniero de Datos, Cloud Native
IDS Comercial
• Migración y CMZ • Recrear y validar estructuras de tablas en CMZ • Migrar datos históricos por tabla con validación de integridad (volúmenes, frecuencias, reglas de negocio) • Reconfigurar scheduled queries que generan tablas derivadas desde EDW PROD / Data Lake • Identificar y documentar dependencias upstream/downstream por dominio • Pipelines e Ingesta • Desarrollar pipelines de ingesta en Airflow hacia capas Raw - Catalog - Cmp • Configurar y validar procesos de carga en el nuevo entorno gobernado • Reconectar integraciones de sistemas y reportes (Looker, Power BI, Tableau) a nuevas tablas • Calidad y Gobernanza • Completar metadata de tablas migradas (owner, descripción, linaje) • Ejecutar pruebas de validación y reconciliación de datos contra fuente original • Levantar tickets JIRA para solicitudes de nuevos datasets con justificación de negocio
Job Requirements
- 3-5 años de experiencia en ingenieria de datos
- Dominio de BigQuery: CREATE TABLE/VIEW, External Tables, Scheduled Queries, optimizacion de queries
- Experiencia con Airflow y/o Concord para orquestación de pipelines
- Capacidad de mapear dependencias de datos y coordinar con owners de negocio
- Atención al detalle en validación de integridad de datos post-migración
- Python para scripting y automatización de tareas de migración
- Experiencia en retail o proyectos de consolidación de datos (deseable)
Benefits
- Empresa Socialmente Responsable (ESR)
- Oportunidades de desarrollo profesional
Related Guides
Related Categories
Related Job Pages
More Cloud Engineer Jobs
• Build and ship internal applications, services, and shared libraries end to end from API to the data layer. • Design, query, and tune our managed data platforms while keeping schemas, migrations, and query performance healthy. • Maintain the internal SDK that routes apps through the model gateway, injects keys, and adds tracing and cost headers, so teams write less code and we keep control of prompts and guardrails. • Run and harden the model gateway used by every team, including high availability across zones and clean dev, staging, and production environments. • Build and operate the cloud services behind the platform, including container compute, managed databases, caching, storage, and secrets. • Build and run the CI/CD pipelines, container registry, and monorepo tooling that every app depends on. • Own platform security maintenance by patching CVEs and security findings quickly during business hours. • Work with the Security team to implement core safety controls, including image and code scanning, secret scanning, access control, identity and sign-on, and audit logging. • Keep the platform reliable and observable through logging, tracing, issue resolution, and steady improvement. • Support cost visibility by tagging usage, building spend and chargeback views, and helping keep spend sensible. • Write clear documentation and provide practical support so teams can adopt the platform without friction.
Senior Data Engineer, AWS, Python, SQL
DevsuDevsu is a technology agency that provides software development services, IT augmentation and staffing.
• Design, build, and maintain scalable data pipelines for analytics, ecommerce, logistics, and marketing. • Improve and maintain the company's data infrastructure and tooling, including Redshift/Snowflake, Airflow, and Fivetran. • Architect data processing systems capable of handling complex data flows and large-scale datasets. • Develop reliable, efficient, and cost-effective data solutions in an AWS environment. • Ensure high standards of data quality through automation and best engineering practices. • Optimize platform performance, resiliency, scalability, and operational costs. • Collaborate closely with software engineers, analysts, and business stakeholders. • Mentor engineers and analysts on data engineering best practices. • Participate in architecture discussions and technical decision-making.
• Architect and develop .NET systems with a focus on performance and scalability; • Collaborate with multidisciplinary teams on the design and implementation of solutions; • Maintain and evolve existing systems following engineering best practices; • Integrate systems with AWS services; • Contribute to the continuous improvement of team processes and practices.
• Design, develop, and maintain data ingestion and transformation pipelines in an Azure Data Lakehouse. • Build solutions using Azure Databricks with PySpark and SQL for data processing and modeling. • Implement and evolve integration and orchestration pipelines using Azure Data Factory. • Perform data audits, validations, and reconciliations using advanced SQL queries. • Monitor pipeline executions, logs, and performance, proposing improvements for performance, architecture, and cost. • Document pipelines, data flows, and architecture following corporate standards. • Work on integration across multiple data sources and environments. • Ensure best practices in data governance, quality, and security.




