Eureka Labs logo
Eureka Labs

Excelling Product Factory Partner for fast-growing marketplaces & SaaS companies. #ThinkBuildEnjoy #ChallengeYourself

Senior Data Engineer, Databricks

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2017H1B No SponsorCompany SiteLinkedIn

Location

Europe

Posted

2 days ago

Salary

0

Seniority

Senior

Bachelor Degree6 yrs expEnglishAWSCloudDockerPySparkPythonSparkSQL

Job Description

Senior Data Engineer, Databricks

Eureka Labs

• Design, build, and maintain scalable data pipelines and data platforms using Databricks, Spark, Python, SQL, and cloud technologies • Develop, optimize, and support both batch and streaming data processing solutions • Implement and maintain reliable, secure, and high-performance data workflows, including orchestration, monitoring, and operational support • Build and evolve data lake and lakehouse solutions to support analytics, reporting, and machine learning initiatives • Collaborate with architects, data engineers, data scientists, analysts, and business stakeholders to translate requirements into scalable technical solutions • Ensure data quality, integrity, availability, and performance across data platforms and pipelines • Contribute to the definition and adoption of data engineering standards, best practices, and design patterns • Participate in software development lifecycle activities, including source control, testing, CI/CD, deployment, and operational support • Evaluate emerging technologies, tools, and best practices to continuously improve the data platform • Provide technical guidance and mentorship to junior engineers when needed

Job Requirements

  • 6+ years of experience in Data Engineering or a related field
  • Strong hands-on experience with Databricks in production environments
  • Strong experience with Spark (PySpark preferred), distributed data processing, and large-scale data workloads
  • Advanced proficiency in Python and SQL
  • Experience designing and building cloud-based data platforms and pipelines (AWS preferred)
  • Experience developing and supporting both batch and streaming data processing solutions
  • Experience optimizing, troubleshooting, and tuning data pipelines and data platforms
  • Experience building and maintaining Data Lake and/or Lakehouse architectures
  • Familiarity with data governance, data quality, data lineage, security, privacy, and retention practices
  • Experience working in Agile environments and collaborating with cross-functional teams
  • Strong ability to work autonomously, take ownership of technical solutions, and provide technical guidance to other engineers when needed
  • Experience with workflow orchestration tools and modern software development practices, including Git, Docker, and CI/CD
  • Experience supporting Machine Learning, Analytics, or Data Science initiatives is a plus
  • Experience in the utilities, energy, or related industries is a plus
  • Strong communication, collaboration, and problem-solving skills
  • Advanced English level (written and spoken)

Benefits

  • flexible work arrangements
  • remote work
  • training and development programs
  • time off policy

Related Categories

Related Job Pages

More Data Engineer Jobs

WLG logo

NATO Talent Pipeline Specialist

WLG

If you've read the description and feel this role is a great match, we'd love to hear from you! Click "Apply for this job" to be directed to a brief questionnaire. It should only take a few moments to complete, and we'll be in touch promptly if your experience aligns with our needs.

Data Engineer2 days ago

Role Description This is not a traditional recruitment role. You will not spend your days sourcing candidates on LinkedIn, negotiating offers, or running full recruitment processes. Instead, your focus will be building and managing a high quality talent pool for NATO related opportunities across NATO countries. You will work at the intersection of talent intelligence, security clearance eligibility assessment, candidate operations, AI tools, and data driven matching. The role is ideal for someone who enjoys structure, process, technology, databases, AI tools, pattern recognition, and working with large volumes of information. What You Will Do - Candidate Qualification & Security Clearance Pipeline - Review incoming candidate profiles and determine whether they fit the type of professionals typically required for NATO projects. - Conduct structured conversations with candidates to understand: - Citizenship and eligibility requirements - Security clearance potential - Professional background - Preferred locations - Salary and rate expectations - Availability and mobility - Maintain accurate candidate records and documentation. - Guide candidates through the initial stages of security clearance preparation and submission processes. - Build and continuously expand our pool of prequalified professionals who may become eligible for future NATO opportunities. - Talent Intelligence & AI Matching - Monitor newly released opportunities across multiple NATO related programs and frameworks. - Use AI tools and internal databases to identify potential candidate matches. - Review AI generated recommendations and validate candidate suitability. - Contact potentially relevant candidates and present matching opportunities. - Collect candidate interest and availability information. - Transfer interested candidates to the recruitment team for full qualification and submission. Qualifications - Strong attention to detail - Excellent organizational skills - Comfortable working with large volumes of CVs and data - Strong written and spoken English - Analytical mindset - Ability to follow structured processes - High level of accuracy and consistency - Comfortable using AI tools in daily work - Experience with databases, ATS systems, CRM systems, recruitment systems, or similar platforms Requirements - Recruitment experience (Nice to Have) - Talent acquisition experience (Nice to Have) - Candidate screening experience (Nice to Have) - Experience working with government, defence, security, public sector, or regulated industries (Nice to Have) - Understanding of security clearance processes (Nice to Have) - Experience with data analysis or talent intelligence (Nice to Have) What Success Looks Like - Growth of the qualified candidate pool - Growth of the security clearance pipeline - Fast identification of relevant candidates for new opportunities - High database accuracy - Effective use of AI driven candidate matching - Strong collaboration with recruiters Who Will Enjoy This Role This role is ideal for someone who enjoys solving talent puzzles, working with data, leveraging AI, organizing information, and building systems. It is less suitable for people who are primarily motivated by sales, business development, or traditional recruitment activities. Company Description We are a boutique technology recruitment company supporting highly specialized projects across Europe and North America, including opportunities connected to NATO and other international organizations. Our team combines deep recruitment expertise with modern technology, AI assisted workflows, and a highly personalized approach to candidate management.

Northern America + 1 moreAll locations: Northern America | Europe
MULTI SEAL Tire Sealants logo

Junior Data Engineer

MULTI SEAL Tire Sealants

Superior Science. Superior Sealants. Since 1981, MULTI SEAL® has manufactured high performance industrial tire sealants.

Data Engineer2 days ago
Full TimeRemoteTeam 11-50Since 1981H1B No Sponsor

• Support the automation, development, maintenance, and optimization of our data pipelines and infrastructure. • Work closely with senior data engineers to process, clean, and transform large datasets, ensuring data integrity and availability for analytics and business decision-making. • Collaborate with cross-functional teams to understand data needs and contribute to improving data workflows. • Develop and maintain Python scripts and applications for data processing, analysis, and automation. • Design, develop, and maintain Power BI dashboards and reports to deliver actionable insights to stakeholders. • Reviewing data for accuracy, completeness and consistency • Organizing and maintaining electronic records for a company’s databases • Analyzing data in order to identify trends and opportunities for improvement • Assisting in creating reports and proposals to present findings to management • Address technical issues and provide IT support to ensure smooth business operations • Support IT management team

Argentina
Five Acts logo

Data Platform Engineer - Senior

Five Acts

Inspiring people through data.

Data Engineer2 days ago
Full TimeRemoteTeam 51-200Since 2005H1B No Sponsor

Role Description - Projetar, construir e manter a Plataforma Interna de Desenvolvimento (IDP) para as equipes de engenharia de dados. - Desenvolver e evoluir pipelines de CI/CD padronizados e reutilizáveis (ex: GitHub Actions, GitLab CI, Azure DevOps). - Gerenciar e escalar infraestrutura em nuvem (AWS, Azure ou GCP) utilizando Infraestrutura como Código (Terraform, Pulumi). - Criar e manter documentação técnica clara e guias de boas práticas para facilitar o onboarding de novos(as) desenvolvedores(as). - Desenhar e liderar a implementação da arquitetura de dados corporativa (Data Lakehouse, Data Warehouse, etc.) em ambiente de nuvem. - Definir e aplicar padrões de modelagem de dados (Dimensional, Data Vault) adequados para as diferentes camadas da arquitetura. - Estabelecer políticas de governança de dados, qualidade de dados, segurança, controle de acesso e conformidade (ex: LGPD). - Avaliar, selecionar e integrar novas ferramentas e tecnologias para a stack de dados moderna (Databricks, Snowflake, dbt, Airflow, Kafka). - Otimizar o desempenho e os custos de processamento de grandes volumes de dados (batch e streaming). Qualifications - Experiência sólida em Engenharia e Arquitetura de Dados, incluindo modelagem de dados, bancos relacionais e NoSQL, processamento distribuído (Spark) e ferramentas de orquestração e transformação de dados. - Experiência em arquitetura de nuvem pública (AWS, Azure ou GCP), Infraestrutura como Código (Terraform) e automação de deploys por meio de práticas e ferramentas de CI/CD. - Habilidade em programação/scripting para automação (Python, Go, ou Bash). - Familiaridade com conceitos de observabilidade. - Experiência em ambientes modernos de engenharia de dados, incluindo plataformas como Databricks, Airflow e ecossistemas analíticos em nuvem. - Fortes habilidades de comunicação para traduzir requisitos complexos de negócio em soluções técnicas. Benefits - Trabalho remoto - Convênio Saúde Mental - psicoterapia online e presencial - Incentivo a certificações e cursos - Convênio para cursos de pós-graduação e MBA (Esalq/USP) - Parceria com escolas de idiomas - Parceria com academias e apps de bem-estar (Wellhub) - Palestras e rodas de conversa internas - Bônus por indicação - Happy hours - Mimos em datas comemorativas

Brazil
M9 Solutions logo

Senior Data Engineer

M9 Solutions

DELIVERING THE DIGITAL FUTURE™

Data Engineer2 days ago
Full TimeRemoteTeam 51-200Since 2007H1B No Sponsor

• Lead workspace architecture, Unity Catalog governance, and cluster policy design for client tenant organizations. • Perform tenant discovery and requirements gathering, source profiling, and security classification for new data intake requests. • Develop end-to-end technical designs for tenant onboarding, including Data Sharing Agreements and SLA documentation. • Maintain Requirements Traceability Matrix (RTM) and prepare Architecture Review Board (ARB) submissions. • Contribute to tenant onboarding automation, financial operations integration, and ROI reporting. • Deliver tenant training materials and facilitate weekly office hours for client program teams. • Support P1/P2 incident response within SLA for tenant-related platform issues. • Provide NIST 800-53 control evidence within 5 business days of the client audit requests.

Washington
$60K - $180K / year