Helping our clients reach their peak
Senior Data Engineer – Apache Spark, Scala
Location
Mexico
Posted
84 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Apache Spark, Scala
Scalepex
• Design, build, and scale robust data pipelines and analytics solutions • Work across the full data lifecycle—from ingestion and transformation to modeling and delivery • Contribute to architectural decisions and best practices
Job Requirements
- 3–7 years of experience in data engineering or software development at an enterprise level
- Strong hands-on experience with:
- Apache Spark (Scala)
- Python
- MySQL and relational databases
- Columnar storage formats (e.g., Apache Parquet)
- Experience with AWS ecosystem, including data lake architectures
- Familiarity with:
- Airflow for orchestration
- Databricks
- CI/CD pipelines (e.g., GitHub Actions)
- Strong understanding of data modeling, storage, and access patterns
- Experience building highly scalable, high-volume data systems
- Solid understanding of ETL processes and data integration layers
- Sr Data Engineer will understand the business need and design the data pipelines, translate data into business insights, data cleansing and ETL.
Benefits
- Contractor scheme
- 100% Remote
Related Guides
Related Job Pages
More Backend Engineer Jobs
• End-to-end responsibility for developing and implementing complex game features (meta-game, economy, social mechanics) • Optimize and maintain high-performance server-side logic within the SFS2X and Hazelcast ecosystem • Designing robust Protobuf-based APIs and handling complex state synchronization between distributed services • Advanced work with PostgreSQL for managing persistent game data and user profiles • Working closely with game designers to translate gameplay ideas into scalable technical solutions • Writing clean, maintainable code and participating in rigorous peer reviews
Golang Backend Developer – Java, Python
BrillioTurning technological disruptions into the advantages. Let's create something Brillian(t) together!
• Design, build, and maintain backend services, APIs, and microservices using Golang, Java and Python • Develop RESTful and/or event‑driven APIs with a focus on performance, scalability, and reliability • Write clean, maintainable, and well‑tested code following best engineering practices • Collaborate with cross‑functional teams to translate business requirements into technical solutions • Optimize application performance, troubleshoot production issues, and implement fixes • Implement secure coding practices, authentication, authorization, and data protection standards • Participate in code reviews, design discussions, and architecture decisions • Support CI/CD pipelines and work closely with DevOps teams for deployments and monitoring • Contribute to documentation, technical standards, and continuous improvement initiatives
Developer, Node.js, TypeScript
valantic DXAThe Digital Agency in Munich. Traunstein. Barcelona. Vienna.
• Support the digital transformation of customer management (CRM) • Build and optimize digital processes • Develop and implement innovative application flows and digital products • Develop scalable web applications based on a Node.js backend • Integrate external interfaces and GraphQL endpoints (Apollo) for an Angular-based frontend • Work with container technologies in the context of Kubernetes and automated deployment solutions • Collaborate closely with colleagues from product/concept, design and development to improve the user experience
• Provide requirements analysis, system design, Python and AI development, troubleshooting, performance optimization, and technical support • Design, develop, and maintain scalable Python applications using FastAPI and Pydantic • Implement asynchronous and parallel programming solutions with asyncio • Conduct thorough code reviews to ensure adherence to established guidelines • Integrate and experiment with multi-modal GenAI models • Work both independently and collaboratively within the team • Provide clear instructions to team members • Communicate with the client on a regular basis • Provide technical leadership for the team




