We are all Humans!
Senior Data Engineer, Python, Databricks, Spark
Location
Portugal
Posted
12 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, Python, Databricks, Spark
HumanIT Digital Consulting
• Design and implement scalable data architectures • Develop robust ETL pipelines • Support advanced analytics initiatives across multiple cloud platforms • Collaborate closely with engineering leadership, stakeholders, and cross-functional teams • Contribute to architectural decisions, engineering best practices, and continuous improvement initiatives • Work on modern cloud-native data platforms supporting both real-time and batch processing workloads • Design end-to-end data pipelines • Build optimized OLAP systems • Enable scalable analytics platforms for complex business domains
Job Requirements
- Minimum 5 years of professional experience as a Data Engineer
- Strong hands-on experience with Python
- Advanced SQL skills for large-scale data processing
- Strong experience with Databricks and Apache Spark
- Experience designing and maintaining ETL pipelines using dbt
- Experience with Apache Airflow for orchestration and workflow automation
- Hands-on experience with cloud platforms including AWS, GCP, or Azure
- Experience with AWS S3, Google BigQuery, Google Cloud Storage, or Azure Databricks
- Knowledge of Infrastructure as Code (IaC) using Terraform
- Experience with event-driven or streaming technologies such as Apache Kafka
- Experience with Docker and Kubernetes
- Strong understanding of dimensional data modeling methodologies including Kimball
- Experience designing OLAP systems, Star Schemas, and Semantic Models
- Understanding of data architecture methodologies such as Inmon and Data Vault
- Experience with CI/CD workflows and Git version control
- Strong communication and collaboration skills
- Ability to work closely with technical and non-technical stakeholders
- Fluency in English
Related Guides
Related Job Pages
More Backend Engineer Jobs
Senior PHP Backend Developer
SepteoSepteo, éditeur de logiciels de référence en Europe, est un groupe qui grandit vite. Qui se transforme. En 10 ans, nous sommes devenus un des leaders européens de la tech, une référence dans l’édition de logiciels. Cette évolution, c’est le fruit d’un collectif. Le résultat d’un travail d’équipes déterminées, audacieuses et engagées. Des équipes qui travaillent main dans la main, dans la simplicité, la convivialité & la confiance. Animés par des valeurs communes, chez Septeo, on est ensemble, on fait ensemble et on transforme ensemble. Et les résultats sont là : aujourd’hui, nous sommes le 8ème plus grand éditeur de logiciels en France au classement Truffle 100 et 9ème au FW500. Notre ambition ne s’arrête pas là. Nous souhaitons devenir incontournable en Europe. Nous sommes déjà présents, derrière chaque moment de vie, grâce aux logiciels que nous développons, mis à la disposition de millions de femmes et d’hommes : un achat immobilier, un mariage, une création d’entreprise, un voyage... C’est une sacrée responsabilité finalement. C’est la nôtre. Et peut-être bientôt la vôtre. Prêt(e) à faire partie de l’aventure ?
Role Description ¿Qué harás? - Desarrollo de nuevas funcionalidades en PHP - Participación en evolución arquitectónica (principios de arquitectura limpia) - Diseño y evolución de APIs - Integración con servicios externos y sistemas de almacenamiento - Participación activa en decisiones técnicas - Desarrollo con enfoque en testing y calidad de código - Trabajo con MySQL y optimización de consultas - Integración de soluciones basadas en IA: - Automatización de procesos - Integración con modelos externos (LLMs, análisis de datos) - Funcionalidades inteligentes sobre datos de RRHH - Mejora de rendimiento y escalabilidad - Desarrollo con enfoque en calidad, testing y buenas prácticas (SDD) Qualifications - Tenga entre 3 y 5 años de experiencia en desarrollo PHP - Experiencia sólida con MySQL - Haya trabajado con arquitecturas limpias o bien estructuradas - Diseñe código mantenible y escalable - Tenga interés en aplicar IA al desarrollo backend - Sea autónomo/a y responsable técnicamente - Quiera participar en decisiones técnicas reales Requirements - Trabajo 100% remoto - Horario flexible real - Plan de crecimiento técnico - Participación activa en decisiones de arquitectura - Cultura cercana, colaborativa y con foco en calidad - Banda salarial acorde a experiencia Benefits Si crees que puedes encajar con esta oferta ¡Ínscribete! Estaremos encantados de conocerte y contarte más sobre Nivimu. Company Description Septeo es un actor de referencia del software en Europa, presente a nivel internacional y reconocido entre los 5 principales editores de software sectorial en Francia. En fuerte crecimiento y en transformación permanente, el grupo se impone como un actor clave de la edición de software gracias a la fuerza de su colectivo: equipos decididos, audaces y comprometidos. En Septeo, la inteligencia artificial está situada en el centro de nuestra evolución. La concebimos como un palanca de rendimiento sostenible, de colaboración y de innovación, integrada de manera responsable en las prácticas del día a día y democratizada en el conjunto de nuestros oficios. La ambición es clara: «make intelligent software for Europe». Nuestra cultura se basa en valores fuertes: ser, hacer y transformar juntos. No es una cultura estática; se vive cada día en nuestras acciones y decisiones, a través de un equilibrio entre rendimiento, responsabilidad y placer. Esta ambición se refleja en lo que hacemos a diario: diseñar software que acompaña los momentos esenciales de la vida, al servicio de millones de ciudadanos. Estar presentes detrás de estos momentos clave es una gran responsabilidad. Es la nuestra. Y quizá pronto la tuya. Unirse a Septeo es integrarse en una aventura colectiva de dimensión internacional, impulsar la transformación del grupo en un entorno en constante y rápida evolución, y hacer de la IA un palanca concreta de creación de valor, hoy y mañana.
• Design and build scalable fintech platforms and backend components using Java. • Refactor and improve code quality, maintainability, and system design. • Develop comprehensive automated test suites and contribute to a strong testing culture. • Automate repetitive processes and improve engineering efficiency. • Collaborate closely with teammates through pair programming and knowledge sharing. • Contribute across different areas of the platform with an 'our code' mindset.
Senior Software Engineer – Backend, AI/ML
ClickHouseClickHouse, Inc. is a database management system that allows users to generate analytical reports using real-time SQL queries. The company’s technology works
• Feature Development: Design and implement AI-powered features across the full stack, from backend inference services to intuitive frontend interfaces within the ClickHouse Cloud platform. • API Architecture: Create robust, scalable APIs that connect ClickHouse's database capabilities with modern AI/ML inference systems and external/internal AI services. • Ecosystem Integrations: Implement and maintain integrations with the broader AI/ML ecosystem and standards, ensuring that ClickHouse as a technology works seamlessly with popular frameworks and tools. • Technical Integration: Integrate models into production systems with proper monitoring, versioning, observability, and evaluation. • Oncall: Participate in the daytime oncall rotation along with the rest of the team. • Developer Experience: Design and implement developer tools, SDKs, and documentation that enable users to leverage ClickHouse’s AI/ML capabilities.
Backend developer
ZensarAt Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus. Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.
Role Description We are seeking an experienced Senior Java Backend Engineer to join our team and contribute to the design and delivery of robust, scalable backend systems. This role is ideal for someone who combines strong engineering fundamentals, distributed systems experience, and modern development practices, with a focus on performance, security, and maintainability. Qualifications - Strong engineering fundamentals - Experience with distributed systems - Modern development practices - Focus on performance, security, and maintainability Requirements - Experience in backend system design and delivery - Ability to work collaboratively in a team environment - Strong problem-solving skills Benefits - Inclusive workplace culture - Opportunities for personal and professional growth - Commitment to well-being and individual celebration
