Scalepex logo
Scalepex

Helping our clients reach their peak

Senior Data Engineer – Apache Spark, Scala

Backend EngineerSoftware EngineerContractRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

Mexico

Posted

84 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer – Apache Spark, Scala

Scalepex

• Design, build, and scale robust data pipelines and analytics solutions • Work across the full data lifecycle—from ingestion and transformation to modeling and delivery • Contribute to architectural decisions and best practices

Job Requirements

  • 3–7 years of experience in data engineering or software development at an enterprise level
  • Strong hands-on experience with:
  • Apache Spark (Scala)
  • Python
  • MySQL and relational databases
  • Columnar storage formats (e.g., Apache Parquet)
  • Experience with AWS ecosystem, including data lake architectures
  • Familiarity with:
  • Airflow for orchestration
  • Databricks
  • CI/CD pipelines (e.g., GitHub Actions)
  • Strong understanding of data modeling, storage, and access patterns
  • Experience building highly scalable, high-volume data systems
  • Solid understanding of ETL processes and data integration layers
  • Sr Data Engineer will understand the business need and design the data pipelines, translate data into business insights, data cleansing and ETL.

Benefits

  • Contractor scheme
  • 100% Remote

Related Job Pages

More Backend Engineer Jobs

iLogos Game Studios logo

Java Developer – Gamedev

iLogos Game Studios

Smart solutions provider for game companies

Backend Engineer84 days ago
ContractRemoteTeam 201-500Since 2006H1B No Sponsor

• End-to-end responsibility for developing and implementing complex game features (meta-game, economy, social mechanics) • Optimize and maintain high-performance server-side logic within the SFS2X and Hazelcast ecosystem • Designing robust Protobuf-based APIs and handling complex state synchronization between distributed services • Advanced work with PostgreSQL for managing persistent game data and user profiles • Working closely with game designers to translate gameplay ideas into scalable technical solutions • Writing clean, maintainable code and participating in rigorous peer reviews

Worldwide
Job Closed
Brillio logo

Golang Backend Developer – Java, Python

Brillio

Turning technological disruptions into the advantages. Let's create something Brillian(t) together!

Backend Engineer84 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

• Design, build, and maintain backend services, APIs, and microservices using Golang, Java and Python • Develop RESTful and/or event‑driven APIs with a focus on performance, scalability, and reliability • Write clean, maintainable, and well‑tested code following best engineering practices • Collaborate with cross‑functional teams to translate business requirements into technical solutions • Optimize application performance, troubleshoot production issues, and implement fixes • Implement secure coding practices, authentication, authorization, and data protection standards • Participate in code reviews, design discussions, and architecture decisions • Support CI/CD pipelines and work closely with DevOps teams for deployments and monitoring • Contribute to documentation, technical standards, and continuous improvement initiatives

New Jersey
$100K - $110K / year
Job Closed
valantic DXA logo

Developer, Node.js, TypeScript

valantic DXA

The Digital Agency in Munich. Traunstein. Barcelona. Vienna.

Backend Engineer84 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Support the digital transformation of customer management (CRM) • Build and optimize digital processes • Develop and implement innovative application flows and digital products • Develop scalable web applications based on a Node.js backend • Integrate external interfaces and GraphQL endpoints (Apollo) for an Angular-based frontend • Work with container technologies in the context of Kubernetes and automated deployment solutions • Collaborate closely with colleagues from product/concept, design and development to improve the user experience

Germany
Full TimeRemoteTeam 11-50Since 2018H1B No Sponsor

• Provide requirements analysis, system design, Python and AI development, troubleshooting, performance optimization, and technical support • Design, develop, and maintain scalable Python applications using FastAPI and Pydantic • Implement asynchronous and parallel programming solutions with asyncio • Conduct thorough code reviews to ensure adherence to established guidelines • Integrate and experiment with multi-modal GenAI models • Work both independently and collaboratively within the team • Provide clear instructions to team members • Communicate with the client on a regular basis • Provide technical leadership for the team

Bulgaria
Job Closed