A tech team you'll love working with.
Data Engineer, Snowflake
Location
Spain
Posted
26 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer, Snowflake
Secret Source
• Building, managing and optimizing data pipelines, views and models • Moving models effectively into production for key data and analytics consumers
Job Requirements
- Experience of Snowflake data platform - SQL , Python
- Experience of Github / Workflows
- Experience of Open flow (Snowflake hosted would be beneficial)
- Experience of building Event driven ingestion pipelines on AWS , SNS , S3 etc.
- Experience of DBT - DBT Core / Dbt Project ( not cloud)
- Experience of Amazon Redshift - optional
- Experience of Data platform migration ( from Redshift to Snowflake preferred)
- Experience of data reconciliation.
- Client facing role , so communication skills are needed
- English Level required: B2 - Independent users of the language, i.e. those who have the necessary fluency to communicate without effort with native speakers.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer (Experience in Banking) KP-001
KeppriEspecialistas en el end to end de activos digitales, staffing y Servicios Tecnológicos. Hazlo fácil con KEPPRI !!!
Role Description Buscamos un(a) Ingeniero de Datos con más de 3-5 años de experiencia, responsable de analizar, diseñar, desarrollar, desplegar y mantener soluciones de datos robustas, eficientes y escalables, tanto en ambientes OnPremise como en ecosistemas Big Data y Cloud. Este rol aportará activamente a la mejora continua, optimización de procesos, mentoría técnica y construcción de productos de datos alineados con la arquitectura y estándares definidos. - Analizar requerimientos y diseñar soluciones de datos alineadas a la visión de Arquitectura de Datos. - Desarrollar y desplegar productos de datos como ETLs, ELTs, APIs y pipelines de información. - Garantizar soluciones eficientes, seguras, mantenibles y alineadas con buenas prácticas como Clean Code. - Aplicar estrategias de validación y testing funcional/no funcional orientadas a datos. - Optimizar consultas, scripts, stored procedures, vistas y otros objetos de base de datos. - Diseñar y modelar bases de datos relacionales y no relacionales. - Construir componentes reutilizables, plantillas y lógicas genéricas para acelerar desarrollos. - Resolver incidentes en estabilización y proponer soluciones sostenibles de largo plazo. - Documentar productos de datos conforme a lineamientos y plataformas definidas. - Participar en programación en pares, onboarding y mentoría de otros Data Engineers. Qualifications - Más de 3-5 años de experiencia en ingeniería de datos o roles afines. - Experiencia en diseño y construcción de Datawarehouse, Datamarts, Datalake, Lakehouse, Data Mesh y Data Fabric. - Dominio en bases de datos relacionales (Oracle, SQL Server, Postgres) y NoSQL (MongoDB, Cassandra, ElasticSearch, Neo4J). - Experiencia con herramientas ETL/ELT como SSIS, Pentaho, SAP Data Services, Talend, Stratio, Azure Data Factory, AWS Glue o DataFlow. - Conocimiento en AWS, Azure y Google Cloud Platform. - Manejo de Apache Spark (SQL y Python), Kafka, Flink, y deseable Scala o Java. - Conocimiento en procesamiento batch y streaming, arquitecturas orientadas a eventos y estrategias DataOps/MLOps. - Experiencia con control de versiones, orquestación y procesos CI/CD. - Deseable conocimiento del sector financiero bancario. Competencies - Liderazgo. - Orientación a objetivos. - Análisis crítico. - Trabajo en equipo. - Comunicación efectiva. - Responsabilidad y planificación. - Proactividad para resolver bloqueantes. - Capacidad de negociación y resolución de conflictos.
Lead Data Engineer
Sur GlobalWe don’t just partner with you, we accelerate your progress and fuel your growth.
• Architect, implement, and maintain scalable data pipelines across core systems. • Build and manage analytics infrastructure using both open-source and commercial tools. • Ensure data quality and schema discipline for operational reliability. • Deliver clean, consistent models and dashboards utilized by multiple teams. • Collaborate with stakeholders to support analytics, business intelligence, and decision-making initiatives.
• Design and implement automated workflows to facilitate cross-system data flow. • Identify and visualize critical interdependencies between hardware components and software systems across the enterprise. • Support the integration of data across programs and the software acquisition pathway to monitor real-time program health. • Analyze large datasets of requirements across multiple programs to pinpoint duplications. • Drive consolidation to eliminate waste and streamline operations. • Develop and maintain data models that allow for "what-if" scenario planning and enterprise-level ontologies to ensure consistent data definitions across various programs. • Utilize data-driven "downtracing" methods to refine solution architectures and ensure every requirement is traceable from high-level mission goals down to technical implementation. • Translate complex data models into compelling narratives, dashboards, and briefings. • Clearly communicate project requirements, resource gaps, and the impact of various investment trade-offs to senior Army leadership.
• Directs and oversees staff providing the data implementation, integration, security, and operations of the War Data Platform Data Operations and Reliability. • Provides direction to and accepts/reviews/rejects a wide variety of contractor-supported deliverables including, but not limited to data engineering, data operations, data governance, and data security. • Conducts continuing reviews and analysis of technology and system development to ensure that the War Data Platform meets CDAO's requirements with respect to functionality, reliability, integrity, and performance. • Directs and/or carries out a wide variety of analysis, design, implementation, and operational tasks associated with the development and delivery of the data integration layer of the War Data Platform to meet the needs of all levels of CDAO's customers, business processes, and functional/non-function requirements. • Participates in top-level decision-making regarding courses of action that will improve the utility and integrity of the War Data Platform's data collection, distribution, cataloging, and management.




