Your friendly global Data & AI Experts! We're an Elite-Tier Databricks Consulting Partner with Azure & AWS Specialisms.
Senior Data Engineering Consultant
Location
United Kingdom
Posted
64 days ago
Salary
£70K - £90K / year
Seniority
Senior
Job Description
Senior Data Engineering Consultant
Advancing Analytics
• Help build AI on a solid, reliable Data Platform • Collaborate with clients and team members to deliver projects • Lead projects while balancing technical and pragmatic needs • Engage in requirements gathering and client consulting
Job Requirements
- Good understanding of core tech stack
- Experience with Microsoft Azure and cloud computing concepts
- Proficiency in Apache Spark – Databricks
- Proficient in Python
- Skilled in writing complex SQL queries
- Familiarity with Azure Data Factory or other cloud orchestration tools
- Knowledge of Azure Data Lake storage and Delta Lake
- Understanding of Data Governance tools like Unity Catalog, Purview
- Experience with IAC tools such as Terraform, Azure DevOps
- Familiarity with visualization tools like Power BI or Tableau
- Understanding of Streaming Data and distributed compute engines
- Strong skills in Requirements gathering and client consulting
- Knowledge of Agile project management
- Understanding of OO Development Practices
- Familiarity with ETL Approaches, Data Quality, and CI/CD methodologies
Benefits
- Industry matching Maternity & Paternity policy
- Private Medical & Dental Care plus Eye care schemes
- Health & Well-being fund
- 25 Days Annual Leave, Birthday Leave & Charity Leave
- Frequent away days with the team
- Annual Bonus Scheme
- Flexible Working Hours
- Electric Car Scheme
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• You will be involved in designing and implementing ETL/ELT pipelines for data integration, transformation, and management. • You will work primarily on Google Cloud Platform and its data processing and orchestration services. • Tasks include data modeling on relational databases, • Development of stored procedures and managing solutions focused on data quality and governance.
Lead Data Engineer, IoT
The Formula ConsultingPersonalberatung Berlin. Personalvermittlung von IT-Profis. 📞 03052105983
• Join a team of 35 experienced engineers specializing in Internet of Things and sensor technology. • In partnership with your hiring manager, convert complex sensor data into robust, scalable, and secure backend architectures. • Architect scalable data platforms and deliver end-to-end analytical solutions. • Optimize ETL processes and improve data quality through effective cleansing and enrichment techniques. • Continuously improve and automate software performance by identifying potential issues and proposing solutions. • Use Grafana to implement alerting mechanisms to detect data anomalies, track data-quality KPIs, and enable data-driven troubleshooting. • Primarily work with Python, Airflow, Docker, Bash, Linux command line, C/C++, and Grafana. • Occasionally support field operations by acquiring sensor data on site and validating the technology through controlled field trials.
Senior Data Engineer – Defense Industry
The Formula ConsultingPersonalberatung Berlin. Personalvermittlung von IT-Profis. 📞 03052105983
• You will be part of a team of 35 software engineers working in the Internet of Things and sensor technology space. • Together with your hiring manager: you will transform complex sensor data into robust, scalable, and secure backend architectures. • You will design scalable data platforms and deliver end-to-end analytics solutions. • You will optimize ETL processes and improve data quality through effective data cleansing and enrichment. • You will continuously improve and automate software performance by identifying potential issues and proposing solutions. • You will use Grafana to implement alerting mechanisms to detect data anomalies, monitor data-quality KPIs, and enable data-driven troubleshooting. • You will primarily work with Python, Airflow, Docker, Bash, the Linux command line, C/C++, and Grafana. • You will occasionally support field deployments, collecting sensor data on-site and validating the technology in field trials.
Senior Data Engineer, IoT
The Formula ConsultingPersonalberatung Berlin. Personalvermittlung von IT-Profis. 📞 03052105983
• You join a team of 35 tech-savvy Internet of Things and sensor technology engineers. • Partnering with your hiring manager, you convert complex sensor data into robust, scalable, and secure backend architectures. • Architect scalable data platforms and deliver end-to-end analytical solutions. • Optimize ETL processes and improve data quality through effective data cleansing and enrichment techniques. • Continuously improve and automate software performance by identifying potential issues and proposing solutions. • Use Grafana to implement alerting mechanisms to detect data anomalies, track data quality KPIs, and enable data-driven troubleshooting. • Work primarily with Python, Airflow, Docker, Bash, the Linux command line, C/C++, and Grafana. • Occasionally support field operations across Germany by collecting sensor data on site and validating technology through controlled field trials.


