IDS Comercial logo
IDS Comercial

Conectando Talento y Tecnología

Ingeniero de Datos, Cloud Native

Cloud EngineerCloud EngineerContractRemoteSeniorTeam 1,001-5,000Since 1982H1B No SponsorCompany SiteLinkedIn

Location

Mexico

Posted

7 days ago

Salary

0

Seniority

Senior

Bachelor Degree3 yrs expSpanishAirflowBigQueryPythonTableau

Job Description

Ingeniero de Datos, Cloud Native

IDS Comercial

• Migración y CMZ • Recrear y validar estructuras de tablas en CMZ • Migrar datos históricos por tabla con validación de integridad (volúmenes, frecuencias, reglas de negocio) • Reconfigurar scheduled queries que generan tablas derivadas desde EDW PROD / Data Lake • Identificar y documentar dependencias upstream/downstream por dominio • Pipelines e Ingesta • Desarrollar pipelines de ingesta en Airflow hacia capas Raw - Catalog - Cmp • Configurar y validar procesos de carga en el nuevo entorno gobernado • Reconectar integraciones de sistemas y reportes (Looker, Power BI, Tableau) a nuevas tablas • Calidad y Gobernanza • Completar metadata de tablas migradas (owner, descripción, linaje) • Ejecutar pruebas de validación y reconciliación de datos contra fuente original • Levantar tickets JIRA para solicitudes de nuevos datasets con justificación de negocio

Job Requirements

  • 3-5 años de experiencia en ingenieria de datos
  • Dominio de BigQuery: CREATE TABLE/VIEW, External Tables, Scheduled Queries, optimizacion de queries
  • Experiencia con Airflow y/o Concord para orquestación de pipelines
  • Capacidad de mapear dependencias de datos y coordinar con owners de negocio
  • Atención al detalle en validación de integridad de datos post-migración
  • Python para scripting y automatización de tareas de migración
  • Experiencia en retail o proyectos de consolidación de datos (deseable)

Benefits

  • Empresa Socialmente Responsable (ESR)
  • Oportunidades de desarrollo profesional

Related Categories

Related Job Pages

More Cloud Engineer Jobs

Sembi logo

Cloud Software Engineer

Sembi

Build with Confidence.

Cloud Engineer7 days ago
Full TimeRemoteTeam 201-500Since 2023H1B No Sponsor

• Build and ship internal applications, services, and shared libraries end to end from API to the data layer. • Design, query, and tune our managed data platforms while keeping schemas, migrations, and query performance healthy. • Maintain the internal SDK that routes apps through the model gateway, injects keys, and adds tracing and cost headers, so teams write less code and we keep control of prompts and guardrails. • Run and harden the model gateway used by every team, including high availability across zones and clean dev, staging, and production environments. • Build and operate the cloud services behind the platform, including container compute, managed databases, caching, storage, and secrets. • Build and run the CI/CD pipelines, container registry, and monorepo tooling that every app depends on. • Own platform security maintenance by patching CVEs and security findings quickly during business hours. • Work with the Security team to implement core safety controls, including image and code scanning, secret scanning, access control, identity and sign-on, and audit logging. • Keep the platform reliable and observable through logging, tracing, issue resolution, and steady improvement. • Support cost visibility by tagging usage, building spend and chargeback views, and helping keep spend sensible. • Write clear documentation and provide practical support so teams can adopt the platform without friction.

United States
Devsu logo

Senior Data Engineer, AWS, Python, SQL

Devsu

Devsu is a technology agency that provides software development services, IT augmentation and staffing.

Cloud Engineer7 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Design, build, and maintain scalable data pipelines for analytics, ecommerce, logistics, and marketing. • Improve and maintain the company's data infrastructure and tooling, including Redshift/Snowflake, Airflow, and Fivetran. • Architect data processing systems capable of handling complex data flows and large-scale datasets. • Develop reliable, efficient, and cost-effective data solutions in an AWS environment. • Ensure high standards of data quality through automation and best engineering practices. • Optimize platform performance, resiliency, scalability, and operational costs. • Collaborate closely with software engineers, analysts, and business stakeholders. • Mentor engineers and analysts on data engineering best practices. • Participate in architecture discussions and technical decision-making.

Honduras
Full TimeRemoteTeam 5,001-10,000Since 1995H1B No Sponsor

• Architect and develop .NET systems with a focus on performance and scalability; • Collaborate with multidisciplinary teams on the design and implementation of solutions; • Maintain and evolve existing systems following engineering best practices; • Integrate systems with AWS services; • Contribute to the continuous improvement of team processes and practices.

Brazil
Minsait logo

Senior Data Engineer – Azure Data Lakehouse

Minsait

Join a more human technology #MoreMinsait

Cloud Engineer7 days ago
Full TimeRemoteTeam 10,001+Since 2016H1B No Sponsor

• Design, develop, and maintain data ingestion and transformation pipelines in an Azure Data Lakehouse. • Build solutions using Azure Databricks with PySpark and SQL for data processing and modeling. • Implement and evolve integration and orchestration pipelines using Azure Data Factory. • Perform data audits, validations, and reconciliations using advanced SQL queries. • Monitor pipeline executions, logs, and performance, proposing improvements for performance, architecture, and cost. • Document pipelines, data flows, and architecture following corporate standards. • Work on integration across multiple data sources and environments. • Ensure best practices in data governance, quality, and security.

Brazil