Job Closed
This listing is no longer active.
Globally recognized digital and engineering solutions partner.
Senior Databricks Engineer
Location
Portugal
Posted
78 days ago
Salary
0
Seniority
Senior
Job Description
Senior Databricks Engineer
opinov8
• Design, develop, and maintain scalable data pipelines using Microsoft Azure and Databricks (Spark). • Build and optimize ETL/ELT workflows in Databricks, leveraging PySpark and SQL for large-scale data processing. • Integrate and land various data sources—including internal, licensed third-party, and public datasets—into the global data lake. • Develop and maintain Delta Lake architectures to ensure reliable, high-performance data storage and processing. • Collaborate with business analysts, data scientists, and engineering teams to define data requirements and deliver high-quality data products. • Use Python and SQL to automate data ingestion, transformation, and validation processes. • Monitor, troubleshoot, and optimize Databricks jobs and clusters for performance, scalability, and cost efficiency. • Implement data quality, governance, and security best practices across the platform. • Participate in documentation, code reviews, and knowledge sharing across a global team.
Job Requirements
- 5+ years of professional experience in data engineering or similar roles.
- Strong hands-on experience with Databricks, including Apache Spark (PySpark/SQL) and Delta Lake.
- Proven experience building scalable data pipelines in Azure (ADF, Synapse, Blob Storage, Azure SQL, Functions, etc.).
- Proficiency in Python and SQL for data engineering and transformation tasks.
- Experience working with large-scale, distributed data processing systems.
- Solid understanding of data modelling, data warehousing, and modern data lake architectures.
- Experience integrating multiple data sources, including structured and unstructured data.
- Strong problem-solving, documentation, and collaboration skills.
Benefits
- Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide.
- Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere.
- Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity.
- Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience.
- Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers.
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Cloud Platforms Engineer
AmcorProducing responsible packaging for food, beverage, pharmaceutical, medical, home and personal-care, and other products.
• Administering and configuration of cloud-based core infrastructure and services • Analyze and translate business requirements into technical requirements • Research and present new cloud technologies and recommendations • Working with leadership to establish cloud technology roadmaps • Prepare and present technical design documentation and task-level project plans • Help identify and communicate risks associated with cloud platforms • Support of Microsoft Azure, AWS, Google and third-party cloud application integrations • Provide highest-level technical support to resolve complex customer problems • Maintain a deep technical knowledge of data center technologies • Mentor and engage others while helping guide the organization’s strategies
• Desarrollo y evolución de un portal corporativo enterprise • Desarrollo de componentes modulares (portlets o equivalentes) • Integración con sistemas corporativos (incluyendo SAP) • Personalización avanzada de temas y estructura del portal • Modelado y gestión de contenidos en CMS corporativo • Participación en decisiones técnicas y definición de buenas prácticas • Resolución de incidencias complejas y revisión de código • Colaboración en entorno internacional (inglés diario)
Senior Graphics Engineer – WebGPU, Vulkan
Huawei Ireland Research CenterBringing together the top research and innovation talent in Ireland to enable a better connected world.
• Implement and optimize WebGPU technology for performance-critical use cases, with a primary focus on mini-games currently. • Drive project execution: propose research projects, propose solutions to problems, develop solution to solve those problems and ensure that these projects are delivered on time. • Develop and deliver proof of concept software deliverables for R&D projects. • Continuously push the boundaries of graphics technology, exploring new ideas and introducing innovative solutions to enhance WebGPU performance and capabilities. • Conduct performance analysis and implement optimizations for real-time rendering and graphics pipelines. • Stay up to date with the latest developments in WebGPU, Vulkan, and real-time rendering technologies and with the publications on major conference venues and journals. • Open & communicative approach, keeping stakeholders fully informed and sharing your experience & expertise with peers. • Availability to travel for technical and scientific conferences, technical exhibitions, meetings with clients and/or other internal teams.
• Ensure the stable operation and maintenance of the existing Citrix environment • Administration and maintenance of Citrix StoreFront, Delivery Controller, WEM, Citrix Studio, as well as VDI and Remote Desktop host infrastructures • Monitoring, troubleshooting and incident resolution during operation • Performing updates, patches and optimizations as part of operations • Documentation of the system landscape and processes • Close collaboration with internal IT teams and external partners
