Helping Visionaries Change the World
Middle Data Engineer, Azure Databricks
Location
Spain
Posted
15 days ago
Salary
0
Seniority
Senior
Job Description
Middle Data Engineer, Azure Databricks
Miratech
• Design, develop, and maintain data pipelines using Azure Databricks • Build and optimize data transformations using PySpark and SQL in Databricks • Implement and maintain Lakehouse architectures using Delta Lake • Develop ETL/ELT pipelines orchestrated through Azure Data Factory • Integrate data from multiple sources into the data platform and analytical layers • Design and maintain data models and data warehouse structures for analytics • Ensure data quality, scalability, and performance of large-scale data processing pipelines • Collaborate with BI teams to support Power BI and reporting platforms • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required • Contribute to the design of modern cloud-based data architectures
Job Requirements
- 3+ years of experience in Data Engineering or Data Warehouse development
- Experience with Azure Databricks
- Experience developing data pipelines using PySpark and Spark SQL
- Solid understanding of distributed data processing and big data concepts
- Experience working with Delta Lake and Lakehouse architectures
- Strong SQL skills and experience with SQL Server relational databases
- Experience building data pipelines using Azure Data Factory
- Experience handling large datasets and performance optimization
- Nice to have
- Experience with Spark optimization techniques (partitioning, caching, cluster tuning)
- Experience with structured streaming in Databricks
- Knowledge of CI/CD pipelines for data platforms (Azure Devops)
- Familiarity with Power BI
- Experience in migrating from traditional ETL process to cloud architectures
Benefits
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Technical ownership of our data platform, including structured and unstructured data repositories, ingestion pipelines and visualisation tools • Develop and maintain ETL/ELT pipelines for ingesting data across operational and analytical systems • Maintain and optimise existing on-premises Microsoft SQL Server environments and associated integrations • Support migration initiatives from legacy data warehousing systems into modern analytical platforms including ClickHouse • Develop data ingestion frameworks capable of handling structured, semi-structured, and streaming data sources • Implement data retention, partitioning, indexing, and optimisation strategies for large datasets • Develop data pipelines and feature engineering workflows to support AI and machine learning initiatives • Optimise SQL queries, indexing strategies, and database performance across multiple environments • Design, develop, and maintain operational dashboards, executive reporting suites, and interactive visualisations for technical and non-technical stakeholders using Microsoft Power BI, Grafana and SQL Server Reporting Services (SSRS) • Ensure a high level of security against unauthorised access to data, data-sources, reports and dashboards, ensuring data is sufficiently partitioned for the relevant users.
Python, Pyspark, GCP Data Engineer
ZensarAt Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus. Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.
Role Description - Design, develop, and maintain end-to-end ETL/ELT pipelines using Python and PySpark. - Build large-scale data processing frameworks to handle structured and unstructured data, ensuring high performance and reliability. - Architect and manage data solutions within the GCP ecosystem, focusing on cost-efficiency and security. - Design and implement robust data warehouse models (Star/Snowflake schemas) and data lake architectures. - Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery for greater scalability. - Work closely with stakeholders to understand data requirements and translate them into technical specifications. Company Description At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. - At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus. - Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. - We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. - We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace.
Role Description Analista/programador o programador senior para desarrollo J2EE. Qualifications - Experiencia mínima en el desarrollo de backends basados en APIs RESTFul en lenguaje Java bajo estándares JEE (JAX-RS, JPA). Benefits - Programa de formación por parte de la empresa para que puedas seguir desarrollándote y promocionar dentro del plan de carrera que existe para ti. - Contrato indefinido y estabilidad. - Retribución flexible y más beneficios. - Flexibilidad horaria. - Modalidad de teletrabajo. - ¡Todos los viernes en jornada intensiva! - ¡Julio y agosto disfrutarás de todas las tardes libres! - Te ofrecemos un entorno dinámico, en el que tu plan de carrera y crecimiento será nuestro objetivo. - Buen ambiente de trabajo, abiertos e inclusivos. - Formarás parte de un gran equipo de profesionales con inquietud y motivación por la tecnología. Company Description Inetum es líder europeo en servicios digitales. El equipo de Inetum, formado por 28.000 consultores y especialistas, se esfuerza cada día por generar un impacto digital en las empresas, las entidades del sector público y la sociedad. Las soluciones de Inetum tienen como objetivo contribuir al desempeño y la innovación de sus clientes, así como al bien común. Presente en 19 países con una densa red de sitios, Inetum se asocia con los principales editores de software para afrontar los desafíos de la transformación digital con proximidad y flexibilidad. Impulsado por su ambición de crecimiento y escala, Inetum generó unas ventas de 2.500 millones de euros en 2023.
• Lead the technical evolution of our data platform. • Design and implement the Unity Catalog structure. • Lead migration of complex business logic from legacy systems. • Architect our internal transformation framework using open-source tooling. • Serve as the resident query performance expert. • Govern our Databricks compute footprint. • Build and maintain CI/CD pipelines to automate testing, validation, and deployment. • Architect the semantic layer in Omni. • Occasionally take on the BI Developer role.



