Goods & Services logo
Goods & Services

Making things better by making better things

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500Since 2013H1B SponsorCompany SiteLinkedIn

Location

Colombia

Posted

5 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishAWSCloudETLPySparkPythonSparkSQL

Job Description

Senior Data Engineer

Goods & Services

• End-to-End Pipeline Engineering: Design, build, and deploy scalable ETL/ELT pipelines from diverse source systems into our Snowflake Data Cloud. • Cloud Infrastructure: Manage and optimize data flows within an AWS environment (S3, Lambda, IAM), ensuring high availability, security, and cost-efficiency. • High-Scale Processing: Leverage Databricks and Python (PySpark) to handle complex data transformations and high-volume workloads. • Implement the Semantic Layer: Collaborate with the team to define, implement, and scale our Semantic Layer (via dbt Semantic Layer, MetricFlow, or similar) to standardize business logic, metrics, and dimensions for all downstream consumers. • Model for Truth: Use dbt to build modular, version-controlled, and tested data models that serve as the definitive foundation for business intelligence.

Job Requirements

  • 5+ years of experience in data architecture, data engineering, or a closely related discipline in a complex, multi-team data environment
  • Data Warehousing: Expert-level proficiency in Snowflake (clustering, Snowpipe, streams, and tasks) or similar cloud data warehouses.
  • Analytics Engineering: Advanced mastery of dbt and complex SQL transformation logic, with specific experience building semantic models and metric definitions.
  • Big Data & Code: Strong Python skills and hands-on experience with Databricks for Spark-based orchestration.
  • Cloud Infrastructure: Practical experience managing data workloads within AWS.
  • Version Control: Deep understanding of Git-based workflows and CI/CD for data.

Related Categories

Related Job Pages

More Data Engineer Jobs

Kitman Labs logo

Data Engineer

Kitman Labs

The evolution of performance

Data Engineer5 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Build and maintain BigQuery data models using Dataform, following medallion architecture patterns (Bronze/Silver/Gold) • Contribute to Looker dashboards and LookML models, working alongside senior engineers and analysts • Write performant, well-structured SQL for large-scale transformations in BigQuery • Implement data quality checks using Dataform assertions and automated alerting • Support data observability across the warehouse — monitoring pipeline health, data freshness, and anomaly detection • Build and maintain robust Python data pipelines with testing, linting, and CI/CD integration • Work with orchestration tooling (Cloud Composer / Airflow) to schedule and monitor workflows • Develop familiarity with CDC concepts and event-driven ingestion patterns (Datastream, Pub/Sub) • Containerise workloads with Docker for deployment on Cloud Run or similar GCP services • Support Data Scientists in moving work from notebook to production pipeline • Contribute to feature pipelines and data preparation for ML workloads • Help bridge the gap between research prototypes and scalable, maintainable code

Ireland
Kitman Labs logo

Data Engineer

Kitman Labs

The evolution of performance

Data Engineer5 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Build and maintain BigQuery data models using Dataform, following medallion architecture patterns (Bronze/Silver/Gold) • Contribute to Looker dashboards and LookML models, working alongside senior engineers and analysts • Write performant, well-structured SQL for large-scale transformations in BigQuery • Implement data quality checks using Dataform assertions and automated alerting • Support data observability across the warehouse — monitoring pipeline health, data freshness, and anomaly detection • Build and maintain robust Python data pipelines with testing, linting, and CI/CD integration • Work with orchestration tooling (Cloud Composer / Airflow) to schedule and monitor workflows • Develop familiarity with CDC concepts and event-driven ingestion patterns (Datastream, Pub/Sub) • Containerise workloads with Docker for deployment on Cloud Run or similar GCP services • Support Data Scientists in moving work from notebook to production pipeline • Contribute to feature pipelines and data preparation for ML workloads • Help bridge the gap between research prototypes and scalable, maintainable code

United Kingdom
Full TimeRemoteTeam 10,001+H1B No Sponsor

Role Description Procuramos um Consultor Sênior de Migração de Dados para reforçar a equipa responsável pela migração de SAP ECC para SAP S/4HANA, abrangendo módulos logísticos e financeiros. O profissional deverá ter experiência sólida em projetos de grande dimensão, envolvendo sistemas SAP e sistemas legados não SAP. O consultor atuará em todo o ciclo de migração — análise, mapeamento, transformação, carga e validação — com interação frequente com o cliente e equipas funcionais. Se você gosta de ambientes dinâmicos, sabe navegar bem entre áreas técnicas e de negócio e quer fazer parte de uma transformação significativa, essa vaga pode ser sua. - Conduzir o processo completo de migração de dados SAP ECC → S/4HANA; - Realizar levantamento, análise e mapeamento de objetos e definição de regras de migração; - Executar extração, transformação e carga de dados utilizando: - SAP Data Services (BODS) - SAP Migration Cockpit - IDocs - LSMW - RFC / integrações - Trabalhar com objetos dos módulos MM, SD, PP, WM, FI e CO; - Coordenar testes de migração, validações, reconciliações e atividades de cutover; - Interagir com o cliente e equipas internacionais para esclarecimentos e validações; - Produzir documentação técnica e funcional em inglês; - Trabalhar de forma colaborativa em ambiente multicultural. Qualifications - Experiência comprovada em migração de dados em projetos SAP; - Participação em projetos de grande porte com sistemas SAP e não SAP; - Domínio de SAP Data Services, Migration Cockpit, IDocs, LSMW e RFC; - Experiência em projetos de migração para S/4HANA; - Boa capacidade de comunicação para interação diária com o cliente; Requirements - Local: Remoto; - Disponibilidade para atuar no horário de Portugal.

GMT to GMT+4
Full TimeRemoteTeam 10,001+Since 2016H1B Sponsor

• Transform data into actionable insights that support revenue growth, operational efficiency, and strategic planning. • Identify and contribute to the development of scalable data tools that improve how data is transformed, managed, and accessed—reducing time to insight. • Build predictive and forecasting models to support revenue growth, marketing effectiveness, and improved customer experiences. • Lead analytics and modeling projects that translate organizational data into clear, data-driven recommendations. • Design and maintain interactive dashboards and reports aligned to key performance indicators (KPIs). • Implement modern tools and techniques to analyze, visualize, and communicate data trends effectively. • Partner with business teams to support operational improvements and growth initiatives, defining measurable outcomes. • Prepare both executive-level summaries and detailed analytical reports, including clear written insights and visual storytelling. • Present findings and recommendations to senior leadership, including options and trade-offs. • Collaborate closely with Finance and executive stakeholders to support recurring business review and planning cycles. • Contribute to additional analytics initiatives as business needs evolve.

Brazil
Job Closed