HumanIT Digital Consulting logo
HumanIT Digital Consulting

We are all Humans!

Senior Data Engineer, Python, Snowflake, Airflow, AWS

Backend EngineerSoftware EngineerFull TimeRemoteSeniorTeam 51-200Since 2020H1B No SponsorCompany SiteLinkedIn

Location

Portugal

Posted

57 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer, Python, Snowflake, Airflow, AWS

HumanIT Digital Consulting

• Architect and operate data-centric systems handling large-scale datasets on AWS • Focus on Snowflake optimization including data modeling, performance tuning, and cost efficiency • Design and orchestrate complex workflows using Apache Airflow • Build data transformations with dbt including modeling, testing, and documentation • Implement both real-time and batch data pipelines leveraging AWS services like S3 • Manage core cloud infrastructure through Infrastructure as Code using Terraform • Ensure engineering excellence through CI/CD pipelines with GitHub Actions • Conduct comprehensive automated testing (unit, linting, integration, end-to-end) • Utilize observability tools like New Relic • Collaborate through Git/GitHub workflows

Job Requirements

  • Strong Python development skills with ability to guide and mentor other engineers
  • Advanced SQL expertise with experience working with large-scale datasets
  • Deep experience with Snowflake including data modeling, optimization, and performance tuning
  • Solid understanding of architectural principles, microservices design, and data-centric systems
  • Hands-on with Apache Airflow for designing, orchestrating, and monitoring workflows
  • Experience with dbt for data modeling, transformations, and testing
  • Proven experience building and operating both real-time and batch data pipelines
  • Hands-on experience with AWS S3 and core cloud services
  • Strong experience with GitHub Actions or similar CI/CD technologies
  • Proficient with Git/GitHub and collaborative development workflows
  • Experience using Terraform for infrastructure management
  • Strong practices across unit testing, linting, integration, and end-to-end tests
  • Experience with structured, semi-structured, and unstructured data
  • Experience with monitoring platforms like New Relic or similar technologies
  • Fluent English (mandatory)

Benefits

  • Flexible work arrangements
  • Professional development opportunities

Related Job Pages

More Backend Engineer Jobs

CompanyCam logo

Staff Software Engineer, Ruby on Rails

CompanyCam

The #1 field service management app for contractors.

Backend Engineer57 days ago
Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor

• Provide technical leadership and architectural guidance across five Core product teams, serving as the primary backend staff engineer for this area of the product. • Float across teams where support is needed: stepping in on high-priority projects, unblocking engineers, and ensuring work gets over the line without dropping the thread on your broader responsibilities. • Design, evolve, and support backend systems and architecture primarily in Ruby on Rails, PostgreSQL, REST, and related technologies, with a focus on performance and reliability at scale. • Get ahead of technical problems — proactively identifying, forecasting, and mitigating risk before it becomes someone else's emergency. • Ensure strong observability across Core systems, including Datadog dashboards, monitoring, and alerting. • Influence long-term technical strategy, balancing short-term delivery with platform health, scalability, and sustainability. • Create clarity around technical decisions, trade-offs, and direction in ambiguous or high-impact situations. • Set and uphold high standards for code quality, security, privacy, observability, and documentation through direct contribution, review, and mentorship. • Mentor senior backend engineers and, over time, help frontend-focused engineers build stronger Ruby on Rails skills. • Act as a force multiplier, enabling teams and individuals without overshadowing or sidelining others.

United States
$190K - $210K / year
Job Closed
Versatile Construction logo

Junior Backend Developer

Versatile Construction

Building certainty, since 1974. A company of Versatile Group.

Backend Engineer57 days ago
Full TimeRemoteTeam 51-200Since 1974H1B No Sponsor

• Conhecer progressivamente os produtos Versat ERP e Versat CRM. • Aprender a metodologia de trabalho da equipe e as boas práticas “ágeis”. • Participar ativamente das cerimônias ágeis e entender o fluxo de trabalho. • Formar-se no Framework Versat utilizando C#, para contribuir no desenvolvimento e correção de funcionalidades sob supervisão. • Analisar tarefas simples junto ao time e entregar soluções alinhadas aos planejamentos. • Apoiar na correção de erros e melhorias de funcionalidades já existentes. • Aplicar boas práticas de codificação, recebendo feedback em revisões de código. • Manter ou ajustar partes do código conforme orientações da equipe sênior. • Elaborar passos básicos de testes para validar suas entregas. • Comunicar avanços, dúvidas e mudanças de forma clara e oportuna. • Desenvolver seus OKRs individuais, com acompanhamento da equipe.

Brazil
Job Closed
Full TimeRemoteTeam 5,001-10,000Since 2005H1B Sponsor

• Design, develop, and deploy scalable, high-performance production-grade backend services and distributed systems to support large-scale model inference. • Make significant contributions to the technical roadmap and architecture of our inference platform, with a focus on low-latency, high-throughput services. • Ensure the reliability, scalability, and efficiency of our production systems using monitoring and observability tools such as Prometheus and Grafana. • Collaborate with data science, product, and engineering teams to align platform capabilities with the company's strategic goals. • Manage and optimize our cloud infrastructure (GCP) and orchestrate workloads using Kubernetes. • Advocate and implement best practices for development, testing, deployment, and monitoring of backend services (DevOps, SRE).

Canada
GitLab logo

Staff Backend Engineer, Go, Continuous Delivery

GitLab

GitLab, founded in 2011 and based in San Francisco, California, maintains a distributed team of professionals that work remotely across multiple continents. GitLab advocates for pr

Backend Engineer57 days ago

• Lead technical execution on the CD platform: decompose complex architectural designs into well-scoped, deliverable work and drive the team to ship with quality and confidence. • Solve high-complexity engineering problems and contribute architectural feedback that shapes how the system evolves. • Set and maintain the technical bar across the codebase through code review, mentorship, and example. • Mentor engineers at all levels, helping them grow their technical capabilities and navigate difficult problems. • Represent the CD team in cross-functional engineering discussions and contribute to written technical proposals and architectural documents. • Participate in on-call rotations to help ensure GitLab.com availability targets are met.

India