We are all Humans!
Senior Data Engineer, Python, Snowflake, Airflow, AWS
Location
Portugal
Posted
57 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, Python, Snowflake, Airflow, AWS
HumanIT Digital Consulting
• Architect and operate data-centric systems handling large-scale datasets on AWS • Focus on Snowflake optimization including data modeling, performance tuning, and cost efficiency • Design and orchestrate complex workflows using Apache Airflow • Build data transformations with dbt including modeling, testing, and documentation • Implement both real-time and batch data pipelines leveraging AWS services like S3 • Manage core cloud infrastructure through Infrastructure as Code using Terraform • Ensure engineering excellence through CI/CD pipelines with GitHub Actions • Conduct comprehensive automated testing (unit, linting, integration, end-to-end) • Utilize observability tools like New Relic • Collaborate through Git/GitHub workflows
Job Requirements
- Strong Python development skills with ability to guide and mentor other engineers
- Advanced SQL expertise with experience working with large-scale datasets
- Deep experience with Snowflake including data modeling, optimization, and performance tuning
- Solid understanding of architectural principles, microservices design, and data-centric systems
- Hands-on with Apache Airflow for designing, orchestrating, and monitoring workflows
- Experience with dbt for data modeling, transformations, and testing
- Proven experience building and operating both real-time and batch data pipelines
- Hands-on experience with AWS S3 and core cloud services
- Strong experience with GitHub Actions or similar CI/CD technologies
- Proficient with Git/GitHub and collaborative development workflows
- Experience using Terraform for infrastructure management
- Strong practices across unit testing, linting, integration, and end-to-end tests
- Experience with structured, semi-structured, and unstructured data
- Experience with monitoring platforms like New Relic or similar technologies
- Fluent English (mandatory)
Benefits
- Flexible work arrangements
- Professional development opportunities
Related Guides
Related Job Pages
More Backend Engineer Jobs
Staff Software Engineer, Ruby on Rails
CompanyCamThe #1 field service management app for contractors.
• Provide technical leadership and architectural guidance across five Core product teams, serving as the primary backend staff engineer for this area of the product. • Float across teams where support is needed: stepping in on high-priority projects, unblocking engineers, and ensuring work gets over the line without dropping the thread on your broader responsibilities. • Design, evolve, and support backend systems and architecture primarily in Ruby on Rails, PostgreSQL, REST, and related technologies, with a focus on performance and reliability at scale. • Get ahead of technical problems — proactively identifying, forecasting, and mitigating risk before it becomes someone else's emergency. • Ensure strong observability across Core systems, including Datadog dashboards, monitoring, and alerting. • Influence long-term technical strategy, balancing short-term delivery with platform health, scalability, and sustainability. • Create clarity around technical decisions, trade-offs, and direction in ambiguous or high-impact situations. • Set and uphold high standards for code quality, security, privacy, observability, and documentation through direct contribution, review, and mentorship. • Mentor senior backend engineers and, over time, help frontend-focused engineers build stronger Ruby on Rails skills. • Act as a force multiplier, enabling teams and individuals without overshadowing or sidelining others.
Junior Backend Developer
Versatile ConstructionBuilding certainty, since 1974. A company of Versatile Group.
• Conhecer progressivamente os produtos Versat ERP e Versat CRM. • Aprender a metodologia de trabalho da equipe e as boas práticas “ágeis”. • Participar ativamente das cerimônias ágeis e entender o fluxo de trabalho. • Formar-se no Framework Versat utilizando C#, para contribuir no desenvolvimento e correção de funcionalidades sob supervisão. • Analisar tarefas simples junto ao time e entregar soluções alinhadas aos planejamentos. • Apoiar na correção de erros e melhorias de funcionalidades já existentes. • Aplicar boas práticas de codificação, recebendo feedback em revisões de código. • Manter ou ajustar partes do código conforme orientações da equipe sênior. • Elaborar passos básicos de testes para validar suas entregas. • Comunicar avanços, dúvidas e mudanças de forma clara e oportuna. • Desenvolver seus OKRs individuais, com acompanhamento da equipe.
• Design, develop, and deploy scalable, high-performance production-grade backend services and distributed systems to support large-scale model inference. • Make significant contributions to the technical roadmap and architecture of our inference platform, with a focus on low-latency, high-throughput services. • Ensure the reliability, scalability, and efficiency of our production systems using monitoring and observability tools such as Prometheus and Grafana. • Collaborate with data science, product, and engineering teams to align platform capabilities with the company's strategic goals. • Manage and optimize our cloud infrastructure (GCP) and orchestrate workloads using Kubernetes. • Advocate and implement best practices for development, testing, deployment, and monitoring of backend services (DevOps, SRE).
Staff Backend Engineer, Go, Continuous Delivery
GitLabGitLab, founded in 2011 and based in San Francisco, California, maintains a distributed team of professionals that work remotely across multiple continents. GitLab advocates for pr
• Lead technical execution on the CD platform: decompose complex architectural designs into well-scoped, deliverable work and drive the team to ship with quality and confidence. • Solve high-complexity engineering problems and contribute architectural feedback that shapes how the system evolves. • Set and maintain the technical bar across the codebase through code review, mentorship, and example. • Mentor engineers at all levels, helping them grow their technical capabilities and navigate difficult problems. • Represent the CD team in cross-functional engineering discussions and contribute to written technical proposals and architectural documents. • Participate in on-call rotations to help ensure GitLab.com availability targets are met.




