Job Closed
This listing is no longer active.
Conectando Talento y Tecnología
Data Engineer
Location
Mexico
Posted
19 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
IDS Comercial
• Diseñar, desarrollar, implementar y ajustar sistemas distribuidos a gran escala y canalizaciones que procesan grandes volúmenes de datos • Centrándose en la escalabilidad, la baja latencia y la tolerancia a fallos en cada sistema construido
Job Requirements
- Inglés avanzado
- Experiencia con Python para escribir canalizaciones de datos y capas de procesamiento de datos
- Amplia experiencia y manejo SQL, optimizadas para la transformación de datos y la implementación de reglas comerciales
- Experiencia práctica con herramientas ETL, como Dataiku, para la preparación, transformación y orquestación de pipelines de datos
- Experiencia en Airflow y Github
- Experiencia con tecnologías en la nube (GCP)
- Experiencia laboral con Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark, HBase, Automic y Aorta
- Experiencia liderando equipos de trabajo
Benefits
- Sueldo base mensual (Esquema 100% nómina)
- Prestaciones de ley
- Bono de asistencia (10% sobre el sueldo base mensual)
- 5% fondo de vivienda (% de Nómina)
- 2% fondo de retiro (% de Nómina)
- Seguro de Gastos Médicos Mayores
- Seguro de Gastos Médicos Menores
- Seguro de Vida por Accidentes
- Caja de Ahorro (Opcional)
- Seguro de Auto por Flotilla (Opcional)
- Convenios Comerciales
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Define and maintain the end-to-end application and data architecture • Establish standards for system design, integration patterns (APIs, middleware, eventing), and data models • Ensure scalability, performance, and long-term maintainability • Act as the technical lead across all external development partners • Review and approve solution designs, code architecture, and technical approaches • Challenge vendors where needed — no rubber stamping • Ensure delivery aligns with architectural standards and business outcomes • Define and oversee data architecture, governance, and quality standards • Manage integration across systems (ERP, CRM, eCommerce, etc.) • Ensure data is usable, reliable, and decision-ready • Partner with leadership to translate business goals into technical roadmaps and system requirements • Simplify complex technical concepts for non-technical stakeholders • Evaluate and guide decisions on SaaS vs. custom development, build vs. buy vs. integrate • Design integration architecture across ERP, marketing systems, and data platforms • Establish architecture governance processes • Participate in sprint reviews, backlog prioritization, and delivery checkpoints • Ensure proper documentation, testing, and deployment standards
Lead Consultant, Data Engineer
LovelyticsLovelytics is a data, AI, and analytics consultancy. Your Data, Our Expertise. Crafting Data Innovation into Reality.
• Utilize consulting and technical skills to be able to work in a client-facing project environment independently • Be responsible for your own execution and sometimes lead individual work streams on client engagements as assigned and under supervision of engagement lead • Collaborate with other team members to successfully deliver on projects • Work effectively and directly communicate with both internal and client and/or partner teams • Develop full ownership of your execution on client engagements • Design and implement complex ETL/ELT pipelines with evidence of improved data processing times • Successfully lead small data warehousing projects with measurable performance enhancements under management of an engagement lead • Contribute to real-time data processing solutions and manage streaming data • Implement security and compliance measures for data pipelines • Design and implement version control and branching strategies and integrate them into CI/CD for promoting and testing in higher environments • Hands-on experience working with SAP data at the table level • Strong understanding of SAP data structures and relationships, beyond ETL tooling • Ability to interpret SAP data in the context of underlying business processes
• Build & Operate Large-Scale Feature Pipelines: Design and maintain batch/streaming pipelines (Spark, Flink, Databricks, Airflow) producing ML features for ranking models. • Ensure Point-in-Time Correctness: Develop feature sets that enable unbiased offline training and credible online inference. • Develop Embedding & Content Pipelines: Build scalable workflows for metadata, imagery, and multimodal representations; partner with Science teams to operationalize new models. • Architect Data Foundations: Design Delta/Parquet data models and medallion layers, optimizing storage layout and partitioning for latency and cost. • Real-Time Engineering: Build Kafka-based systems for real-time features and user-activity aggregations, ensuring robust handling of out-of-order events and exactly-once semantics. • Governance & Leadership: Define data quality rules and schema evolution processes while collaborating across ML pods to translate model needs into infrastructure.
• Design, develop, and maintain ETL/ELT data pipelines supporting enterprise data platforms. • Implement and enhance data ingestion, transformation, and integration processes using SQL and modern programming languages. • Design and implement automated data quality and validation checks (e.g., schema integrity, completeness, freshness, volume). • Embed data validation and testing logic directly into data pipelines and CI/CD workflows. • Refactor and modernize existing data pipelines to improve reliability, performance, and maintainability. • Collaborate with technical leads, architects, and engineering teams to define and promote standard data engineering and quality practices. • Support deployment, monitoring, and troubleshooting of data pipelines across development, test, and production environments. • Contribute to technical documentation, runbooks, and reusable components to improve team efficiency and consistency. • Participate in design and code reviews with a focus on sustainability, automation, and operational excellence.




