Advancing Analytics logo
Advancing Analytics

Your friendly global Data & AI Experts! We're an Elite-Tier Databricks Consulting Partner with Azure & AWS Specialisms.

Senior Data Engineering Consultant

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2018H1B No SponsorCompany SiteLinkedIn

Location

United Kingdom

Posted

64 days ago

Salary

£70K - £90K / year

Seniority

Senior

Job Description

Senior Data Engineering Consultant

Advancing Analytics

• Help build AI on a solid, reliable Data Platform • Collaborate with clients and team members to deliver projects • Lead projects while balancing technical and pragmatic needs • Engage in requirements gathering and client consulting

Job Requirements

  • Good understanding of core tech stack
  • Experience with Microsoft Azure and cloud computing concepts
  • Proficiency in Apache Spark – Databricks
  • Proficient in Python
  • Skilled in writing complex SQL queries
  • Familiarity with Azure Data Factory or other cloud orchestration tools
  • Knowledge of Azure Data Lake storage and Delta Lake
  • Understanding of Data Governance tools like Unity Catalog, Purview
  • Experience with IAC tools such as Terraform, Azure DevOps
  • Familiarity with visualization tools like Power BI or Tableau
  • Understanding of Streaming Data and distributed compute engines
  • Strong skills in Requirements gathering and client consulting
  • Knowledge of Agile project management
  • Understanding of OO Development Practices
  • Familiarity with ETL Approaches, Data Quality, and CI/CD methodologies

Benefits

  • Industry matching Maternity & Paternity policy
  • Private Medical & Dental Care plus Eye care schemes
  • Health & Well-being fund
  • 25 Days Annual Leave, Birthday Leave & Charity Leave
  • Frequent away days with the team
  • Annual Bonus Scheme
  • Flexible Working Hours
  • Electric Car Scheme

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 201-500H1B No Sponsor

• You will be involved in designing and implementing ETL/ELT pipelines for data integration, transformation, and management. • You will work primarily on Google Cloud Platform and its data processing and orchestration services. • Tasks include data modeling on relational databases, • Development of stored procedures and managing solutions focused on data quality and governance.

United States
Job Closed
The Formula Consulting logo

Lead Data Engineer, IoT

The Formula Consulting

Personalberatung Berlin. Personalvermittlung von IT-Profis. 📞 03052105983

Data Engineer64 days ago
Full TimeRemoteTeam 1-10Since 2023H1B No Sponsor

• Join a team of 35 experienced engineers specializing in Internet of Things and sensor technology. • In partnership with your hiring manager, convert complex sensor data into robust, scalable, and secure backend architectures. • Architect scalable data platforms and deliver end-to-end analytical solutions. • Optimize ETL processes and improve data quality through effective cleansing and enrichment techniques. • Continuously improve and automate software performance by identifying potential issues and proposing solutions. • Use Grafana to implement alerting mechanisms to detect data anomalies, track data-quality KPIs, and enable data-driven troubleshooting. • Primarily work with Python, Airflow, Docker, Bash, Linux command line, C/C++, and Grafana. • Occasionally support field operations by acquiring sensor data on site and validating the technology through controlled field trials.

Germany
€70K - €85K / year
Job Closed
The Formula Consulting logo

Senior Data Engineer – Defense Industry

The Formula Consulting

Personalberatung Berlin. Personalvermittlung von IT-Profis. 📞 03052105983

Data Engineer64 days ago
Full TimeRemoteTeam 1-10Since 2023H1B No Sponsor

• You will be part of a team of 35 software engineers working in the Internet of Things and sensor technology space. • Together with your hiring manager: you will transform complex sensor data into robust, scalable, and secure backend architectures. • You will design scalable data platforms and deliver end-to-end analytics solutions. • You will optimize ETL processes and improve data quality through effective data cleansing and enrichment. • You will continuously improve and automate software performance by identifying potential issues and proposing solutions. • You will use Grafana to implement alerting mechanisms to detect data anomalies, monitor data-quality KPIs, and enable data-driven troubleshooting. • You will primarily work with Python, Airflow, Docker, Bash, the Linux command line, C/C++, and Grafana. • You will occasionally support field deployments, collecting sensor data on-site and validating the technology in field trials.

Germany
€70K - €85K / year
Job Closed
The Formula Consulting logo

Senior Data Engineer, IoT

The Formula Consulting

Personalberatung Berlin. Personalvermittlung von IT-Profis. 📞 03052105983

Data Engineer64 days ago
Full TimeRemoteTeam 1-10Since 2023H1B No Sponsor

• You join a team of 35 tech-savvy Internet of Things and sensor technology engineers. • Partnering with your hiring manager, you convert complex sensor data into robust, scalable, and secure backend architectures. • Architect scalable data platforms and deliver end-to-end analytical solutions. • Optimize ETL processes and improve data quality through effective data cleansing and enrichment techniques. • Continuously improve and automate software performance by identifying potential issues and proposing solutions. • Use Grafana to implement alerting mechanisms to detect data anomalies, track data quality KPIs, and enable data-driven troubleshooting. • Work primarily with Python, Airflow, Docker, Bash, the Linux command line, C/C++, and Grafana. • Occasionally support field operations across Germany by collecting sensor data on site and validating technology through controlled field trials.

Germany
€70K - €85K / year
Job Closed