We’re a tech consultancy, expert in software engineering and cloud transformation.
Senior Data Engineer, GCP
Location
Portugal
Posted
8 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, GCP
Vigil
• Join our engineering team and be a valued member working closely in a collaborative, autonomous, cross-functional team • Build and maintain scalable data processing platforms and services on GCP • Design and develop event-driven architectures using GCP-native services • Develop and maintain data pipelines and backend services using Python • Contribute to infrastructure automation and platform provisioning using Terraform • Support containerised workloads running on GKE • Implement monitoring, observability, and operational best practices • Collaborate closely with product and engineering teams to deliver reliable platform capabilities • Participate in platform support and operational ownership activities • Improve testing, deployment, and software delivery practices • Contribute to architectural discussions and long-term platform evolution
Job Requirements
- Strong experience working within cloud-native engineering environments
- Strong hands-on experience with Google Cloud Platform (GCP)
- Experience with BigQuery, Pub/Sub, Dataflow, and Cloud Functions
- Strong Python development experience
- Experience building and supporting distributed systems
- Experience with Infrastructure as Code using Terraform
- Understanding of containerised environments and Kubernetes concepts
- Experience with CI/CD pipelines and modern engineering practices
- Strong problem-solving skills and systems-thinking mindset
- Experience working in Agile development environments, particularly in a Scrum framework
- Strong English communication skills, both written and verbal
- Awesome but not required:
- Experience with GKE
- Experience working with Go
- Experience working with Java
- Experience with Kafka
- Experience with Grafana, Prometheus, or similar observability tooling
- Experience managing cloud IAM and security controls
- Experience supporting high-volume data platforms
Benefits
- Be part of our collegial environment where responsibility and authority are shared equally amongst colleagues and help create our company culture
- A culture in which we don’t criticise failure but ensure we learn from our mistakes
- An Agile environment where your ideas are welcome
- The possibility to grow and experience different projects
- Ongoing Training & Mentoring
- The possibility of travelling
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design and implement ETL processes in a cloud environment • Design and implement monitoring solutions for ETL processes • Document datasets for data warehouse consumers • Serve as a technical resource for consumers of the data warehouse, in particular the Data Science Team and other internal business units
Senior Data Engineer – Enterprise B2B Marketplace
Truelogic SoftwarePremium boutique software development company that helps brands with big ideas to make a difference in people’s lives.
• Data Platform Evolution: Guide the foundational architecture, scaling strategies, and long-term roadmap of the enterprise data platform. • Pipeline Engineering: Design and lead the development of highly scalable data pipelines using Airflow, dbt, and Python. • Modern Stack Integration: Build and maintain high-throughput integrations across core modern data stack tools, including Fivetran, Redshift, and Sigma. • Serverless Architecture: Develop and optimize serverless data services and ingestion layers leveraging AWS infrastructure (e.g., AWS Lambda). • Advanced Data Modeling: Partner with cross-functional stakeholders to define reliable, performant data warehouse architectures and analytical datasets. • Observability & Reliability: Implement automated testing, rigorous monitoring frameworks, and tracing to maximize pipeline reliability and minimize operational downtime. • Technical Leadership & Governance: Mentor data engineers and analysts on engineering best practices, while driving continuous improvements in data governance and documentation.
• Run and monitor recurring data update and ingestion jobs. • Perform basic data editing, formatting, and normalization in SQL-based workflows. • Support the transformation of raw or external data into usable internal formats. • Assist in data validation, anomaly tracking, and issue escalation. • Document standard workflows for future execution and training.
Senior Data Engineer – Enterprise B2B Marketplace
Truelogic SoftwarePremium boutique software development company that helps brands with big ideas to make a difference in people’s lives.
• Data Platform Evolution: Guide the foundational architecture, scaling strategies, and long-term roadmap of the enterprise data platform. • Pipeline Engineering: Design and lead the development of highly scalable data pipelines using Airflow, dbt, and Python. • Modern Stack Integration: Build and maintain high-throughput integrations across core modern data stack tools, including Fivetran, Redshift, and Sigma. • Serverless Architecture: Develop and optimize serverless data services and ingestion layers leveraging AWS infrastructure (e.g., AWS Lambda). • Advanced Data Modeling: Partner with cross-functional stakeholders to define reliable, performant data warehouse architectures and analytical datasets. • Observability & Reliability: Implement automated testing, rigorous monitoring frameworks, and tracing to maximize pipeline reliability and minimize operational downtime. • Technical Leadership & Governance: Mentor data engineers and analysts on engineering best practices, while driving continuous improvements in data governance and documentation.
