At Cloudera, we believe that data can make what is impossible today, possible tomorrow.
Technical Lead, Spark
Location
Spain
Posted
8 days ago
Salary
0
Seniority
Senior
Job Description
Technical Lead, Spark
Cloudera
• Design new features for Cloudera’s data engineering experience, and take them from prototypes to leading a team to deliver the feature in production at scale • Contribute to Apache Spark, Livy • Develop new features in Scala/Java/Python on a modern platforms • Gain expertise in distributed data processing, from SQL planners and optimizers, to data layout and table formats like Apache Parquet and Iceberg, to fault tolerance in distributed systems. • Gain a solid understanding and deep technical knowledge of components across the Cloudera Data Engineering Experience stack, but focusing on Iceberg and Spark, which you can utilize in your daily tasks • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures • Work on improving internal infrastructure • Collaborate with other team members and stakeholders
Job Requirements
- Bsc/Msc in related field or equivalent experience
- 6+ years professional software development.
- Experience leading and delivering complex product enhancements.
- Strong understanding of at least one of the following languages: Java, Scala, Python.
- Experience with systems design, development.
- Strong oral and written communication skills.
- Strong ability to research and solve problems independently without constant supervision.
- Open-minded, desire to learn new things and build great products.
- Experience with distributed systems
- Experience with SQL planners
- Experience with using/developing Apache Spark, Livy or other related technologies.
- Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling.
- Solid experience with at least one cloud services.
Benefits
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Develop full-stack websites and products: Build and deploy fully functional websites and digital products, covering both front-end and back-end development. • Write clean, efficient, and well-documented code that delivers a seamless user experience. • Design, implement, and maintain enterprise business websites: Create, update, and manage business websites on various platforms, including custom in-house CMS, BrightSpot, and Salesforce. • Ensure websites remain modern, secure, and optimized for performance. • Author developer-friendly documentation: Draft and maintain clear technical documentation that explains code structures, APIs, workflows, and troubleshooting steps. • Ensure that documentation supports easy handoffs and collaborative teamwork. • Use version control systems, specifically GitHub: Regularly manage code changes using GitHub and follow best practices for version control. • Create pull requests, review code, and maintain organized repositories to support team collaboration. • Work with internal customers to solve website bugs and close tickets: Troubleshoot, diagnose, and resolve website issues for internal stakeholders. • Communicate solutions clearly and close support tickets in a timely manner. • Support and learn from senior developers: Collaborate with senior team members to enhance technical skills and apply best practices. • Participate in peer programming, code reviews, and knowledge-sharing sessions. • Drive rapid execution across a steady stream of ideas while seamlessly taking on multiple roles: Adapt to a fast-paced environment with shifting priorities and new challenges. Tackle urgent updates, experiment with new tools, and contribute to multiple IT and Innovation projects as needed.
Staff Engineer, AI Productivity
HightouchSync customer data from your warehouse into the tools your business teams rely on.
• Own the agentic development environment: Ensure agents can operate in independent cloud-based development environments, execute our full test suites, examine build results visually, etc • Build our tooling integrations: Build MCP server integrations that connect our agents to the systems needed to build and debug software, such as CircleCI, Slack, Datadog, Github, etc • Documentation and context: Own our repo-wide agents.md file and work with teams to ensure our library of agent guidance and skills is continually pushing the bar • Enablement: Work with our engineers to understand where agents are struggling and address root causes such as better docs, tooling access, etc • Serve as a “PM” for internal AI agents: Consistently keep us on the leading edge of AI productivity trends by staying abreast of what is state-of-the-art in industry
Title: Senior Full Stack Developer Location: 317 Adelaide Street West, Toronto, Ontario, Canada, M5V 1P8 Job Description: We are seeking a Senior Full-Stack Engineer to join our growing Engineering team at Thrive. This role is ideal for someone who thrives in a fast-paced startup environment, enjoys solving challenging problems, and is passionate about building high-quality, scalable software that impacts millions of career journeys. As a key contributor, you will ship end-to-end features, collaborate closely with product and design, and play a meaningful role in shaping our technology, processes, and engineering culture. If you enjoy autonomy, mentorship, and working with modern technologies, this role is a strong fit. Key Responsibilities: - Act as a key member of the Engineering team, responsible for shipping end-to-end features frequently and with confidence. - Work collaboratively with product managers and designers, guiding decisions based on deep knowledge of codebase structure and technical feasibility. - Participate in code reviews, providing constructive feedback and maintaining high code quality across the team. - Mentor and be mentored by engineers at various levels, fostering a culture of continuous learning and technical growth. - Actively engage in team rituals such as retrospectives, contributing to ongoing improvements in technology, processes, and team culture. - Give and receive feedback in support of a safe, collaborative, and growth-oriented engineering environment. Business Problem the Senior Full-Stack Engineer Will Solve: This role will help drive the development of scalable, reliable features that support Thrive’s mission to advance career wellness. By building high-quality systems and collaborating across the organization, you will directly contribute to delivering impactful solutions that serve millions of users navigating their career journeys. Ideal Candidate Demographics (Experience & Skills): - 5+ years of experience as a professional software developer shipping production-level code. - Proficiency building single-page applications using JavaScript frameworks such as Ember or React. Extensive experience with Angular, Vue, or similar frameworks will also be considered. - Proficiency building scalable distributed backend services using Ruby on Rails and PostgreSQL. Experience with Sinatra, Django, Phoenix, Node, or mySQL is also accepted. - Strong experience with modern testing frameworks (RSpec, Cypress, Jest, QUnit, or equivalents). - Proven ability to build and maintain fully automated CI/CD pipelines. - Proficiency working in cloud environments, ideally AWS; experience with GCP or Azure is also valuable. Life at Thrive: - High-trust environment with autonomy, ownership, and flexibility - Fast-paced startup culture with strong mentorship and growth opportunities - Fully remote work environment with optional access to downtown Toronto office space Total Rewards Package: - 3 weeks paid vacation - Health Insurance & Wellness Coverage - Yearly Learning & Development Allowance - Yearly Workspace Allowance - Access to licensed learning platforms This posting is for an existing position; Thrive is recruiting to fill a vacancy created by a departure, not a new role. Thrive uses artificial intelligence tools to assist in the screening and assessment of applications. AI may be used to review resumes and support initial candidate evaluation, though all hiring decisions are made by Thrive personnel. If you require accommodation at any time during the recruitment process, please let us know. At Thrive, we understand and value diversity in our employees and are proud to be an Equal Opportunity Employer. Only those legally entitled to work in Canada will be considered for interview and employment
• Drive Prompt's mission to improve healthcare through high-quality, actionable data and analytics that inform client and internal decision-making • Build full-stack data and analytics features end-to-end — from building the data models, analyzing the data, to the user-facing interfaces that surface insights • Build AI and LLM-powered workflows that accelerate data transformation, analysis, and app development — while maintaining high standards for reliability and maintainability • Own the design, development, and iteration of complex data systems, including the building data transformations, and well-modeled datasets • Develop and ship analytics products and dashboards used by clients and internal teams • Perform exploratory analysis and hypothesis-driven investigations to surface insights and guide product and operational decisions • Influence data engineering team strategy and product architecture for data and analytics surfaces • Partner with stakeholders across the company to understand client and internal workflows, define success criteria, and deliver products that drive improvement


