Data Engineer
Location
Colombia
Posted
92 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
Iluma Alliance
• Diseñar y construir pipelines de datos: Diseñar, construir y mantener pipelines para la ingestión, limpieza, transformación y carga (ETL/ELT) de datos desde múltiples fuentes hacia almacenes de datos y plataformas analíticas. • Administración de la infraestructura y almacenamiento de datos: Configurar y administrar bases de datos, sistemas de almacenamiento y herramientas de procesamiento. • Optimización de rendimiento y eficiencia: Identificar y resolver cuellos de botella en pipelines y sistemas de almacenamiento. • Gestión de metadatos y documentación: Desarrollar y mantener mecanismos de catalogación y documentación para conjuntos de datos, pipelines y procesos de transformación. • Seguridad, control y cumplimiento de datos: Implementar medidas de seguridad y cumplimiento para proteger la confidencialidad, integridad y disponibilidad de la información. • Colaboración e integración con equipos y productos: Trabajar de forma articulada con equipos de ciencia de datos, producto, ingeniería de software y operaciones. • Entendimiento del negocio para orientar el uso del dato: Profundizar en el conocimiento del negocio y del sector.
Job Requirements
- Mínimo 3 años de experiencia en roles relacionados con análisis de datos, ingeniería de datos o desarrollo de soluciones analíticas.
- Experiencia demostrada conectando fuentes de datos diversas, automatizando procesos y visualizando información para áreas de negocio.
- Conocimiento específico en: SQL y manejo de sistemas de gestión de bases de datos como PostgreSQL, MySQL, entre otros.
- Tecnologías de almacenamiento de datos, incluyendo data lakes y/o data warehouses (Redshift, BigQuery, Snowflake).
- Programación: Manejo de Python para automatización, ETL y análisis.
- Herramientas de orquestación de flujos de datos como Airflow o similares.
- Visualización: Desarrollo de dashboards en Qlik (preferible), Power BI o Tableau.
- Integración de datos desde múltiples fuentes: APIs, archivos planos, sistemas internos, entre otros.
- Entornos de nube como AWS (S3, Redshift, Glue), GCP o Azure.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Data Engineer will work closely with the rest of the product team and business peers to effectively execute Data project initiatives. • Deliver in a fast-paced and deadline-driven environment. • Responsible for maintenance of the data applications and expected to automate processes with no or minimal human intervention. • Development and maintenance of ELT snowflake data warehouse solutions. • Collaborate with internal and external technology and business partners to implement product changes. • Produce detail design and unit test documents, as required. • Critically analyze business requirements, architect and implement Data solutions. • Define, develop and maintain standards and processes to ensure effective ETL solution Production maintenance. • Work closely with product manager to develop and execute action plans to address gaps. • Recommend innovations that enhance and/or provide a competitive advantage to the organization. • Communicate effectively with both the business and technical teams. • Mentor junior offshore developers to accomplish results. • Build and continuously improve data engineering best practices.
• Build data applications and processes using Python, SQL, and Django; manage and query data in PostgreSQL, Oracle, and cloud-native databases • Examine, extract, cleanse, and load data while implementing quality assurance rules and tools to ensure consistent and accurate data • Work with healthcare-specific data processes such as EDI file transfers, claims adjudication, audits, eligibility verification, and reporting workflows • Collaborate with cross-functional teams (Data Analysts, Data Scientists, Product, Reporting, Account Management) to define requirements and deliver data-driven solutions • Ensure data quality, integrity, and security through automated validation, auditing, and monitoring, with compliance to HIPAA and CMS regulations • Monitor, maintain, and tune pipeline performance; proactively troubleshoot and resolve complex data flow and system issues • Provide technical mentorship to Data Engineers, sharing expertise in data modeling, pipeline development, and troubleshooting practices • Research and propose improvements to the tech stack and data engineering processes • Participate in sprint planning, refinement, and estimation to support implementation awareness and delivery
• Analyse and ingest new datasets from varied sources • Design, build, and support cloud infrastructure • Design, build, and support AI and ML processes and infrastructure • Design and build modern, metadata driven data pipelines and data streams • Design and build data service APIs • Transform and cleanse complex datasets • Analyse current business practices, processes and procedures • Implement effective metrics and monitoring processes
• Develop and maintain enterprise data models aligned with federal and state standards. • Design data integration strategies across multiple systems and agencies. • Ensure compliance with FISMA, FedRAMP, NIST, and applicable state data security frameworks. • Serve as a trusted advisor to federal and state clients, translating business needs into technical solutions. • Lead customer workshops, requirements sessions, and architecture reviews. • Communicate complex technical concepts clearly to non-technical stakeholders. • Establish data governance policies, metadata management, and stewardship practices. • Implement data quality frameworks and monitoring processes. • Architect solutions leveraging AWS, Azure, or GCP for government workloads. • Support migration from legacy systems to modern cloud-based platforms. • Partner with federal and state stakeholders, program managers, and technical teams to align data strategies with mission objectives. • Mentor junior architects and data engineers.




