Job Closed
This listing is no longer active.
At Cloudera, we believe that data can make what is impossible today, possible tomorrow.
Staff Software Engineer - Airflow
Location
United States
Posted
81 days ago
Salary
0
Seniority
Lead
Job Description
Staff Software Engineer - Airflow
Cloudera
Business Area: Engineering Seniority Level: Mid-Senior level Job Description: At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance. As a Staff Software Engineer, Airflow, you will be a key technical leader, responsible for the architecture, technical vision, and strategic evolution of the Apache Airflow-based workflow orchestration platform within the company’s data ecosystem. You will be expected to solve the most complex, ambiguous, and high-impact technical problems that span multiple teams or organizational boundaries. As a Staff Software Engineer you will: - Technical & Architectural Leadership: Drive the multi-quarter technical roadmap and architecture for the Airflow platform, ensuring it is secure, highly scalable, reliable, and cost-efficient for enterprise-grade workloads. - Complex Problem Solving: Design and implement solutions for the most challenging technical issues, such as extreme scale, multi-tenancy isolation, complex scheduling, and hybrid/multi-cloud deployment models. - Cross-Functional Impact: Collaborate closely with product management, principal engineers, and other platform teams (e.g., Spark, Kubernetes) to define and deliver core orchestration capabilities that influence the entire data platform. - Engineering Excellence: Define and champion best practices, performance optimization, and quality standards (observability, testing, and fault tolerance) for the Airflow service and its integrations. - Mentorship: Mentor senior and junior engineers on complex technical design, best practices, and execution, elevating the overall technical capacity of the team and organization. - Open Source: Maintain significant contributions and influence within the Apache Airflow open-source community, aligning the project’s roadmap with product strategy. We are excited if you have (Required Qualifications): - Bachelor’s degree in Computer Science or equivalent, and 6+ years of experience - Deep Airflow Expertise: Deep, hands-on knowledge of Apache Airflow internals (scheduler, executor, serialization, REST APIs) and complex DAG authoring/optimization. - Programming: Mastery in Python, some Java experience and extensive experience with core data platform technologies and cloud-native deployments (e.g., Kubernetes, Cloud Composer, AWS/GCP/Azure). - Systems Thinking: Demonstrated ability to drive design and architectural decisions with a focus on non-functional requirements (security, performance, high availability, fault tolerance). - Leadership: Proven ability to lead and drive technical projects across multiple teams without direct reporting authority. You may also have: - Experience defining the architecture for multi-tenant, service-oriented data platforms. - Significant contributions to Apache Airflow or related open-source projects. - Background in performance tuning and profiling large-scale Python and distributed applications. - Familiarity with data governance and security frameworks (e.g., Ranger, Kerberos) and their integration with workflow orchestration. Why this role matters: You will tackle complex distributed systems challenges, crafting the foundational software for the control and data planes that powers CDP and keeps it running at massive scale. Working at the forefront of hybrid and multi-cloud technology, you will empower data scientists, engineers, and analysts with the tools and infrastructure they need for advanced analytics and modeling. Collaboration is key, you will work alongside brilliant minds across product, data science, and engineering to drive innovation, standardize best practices, and shape the future of enterprise AI and data platforms. This is your chance to build the future of data and see your work make a global impact. This role is not eligible for immigration sponsorship. What you can expect from us: - Generous PTO Policy - Support work life balance with Unplugged Days - Flexible WFH Policy - Mental & Physical Wellness programs - Phone and Internet Reimbursement program - Access to Continued Career Development - Comprehensive Benefits and Competitive Packages - Paid Volunteer Time - Employee Resource Groups EEO/VEVRAA #LI-REMOTE #LI-SZ1
Job Requirements
- Bachelor’s degree in Computer Science or equivalent, and 6+ years of experience
- Deep, hands-on knowledge of Apache Airflow internals (scheduler, executor, serialization, REST APIs) and complex DAG authoring/optimization.
- Mastery in Python, some Java experience and extensive experience with core data platform technologies and cloud-native deployments (e.g., Kubernetes, Cloud Composer, AWS/GCP/Azure).
- Demonstrated ability to drive design and architectural decisions with a focus on non-functional requirements (security, performance, high availability, fault tolerance).
- Proven ability to lead and drive technical projects across multiple teams without direct reporting authority.
- Experience defining the architecture for multi-tenant, service-oriented data platforms.
- Significant contributions to Apache Airflow or related open-source projects.
- Background in performance tuning and profiling large-scale Python and distributed applications.
- Familiarity with data governance and security frameworks (e.g., Ranger, Kerberos) and their integration with workflow orchestration.
Benefits
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
Related Guides
Related Job Pages
More Software Engineer Jobs
Senior Software Engineer
Allied Benefit SystemsA healthcare solutions company, Allied Benefit Systems offers insurance products and custom insurance services to individuals and businesses as one of the largest third-party admin
Job DetailsJob Location: Allied Benefit Systems - CHICAGO, IL 60606Position Type: Full TimeSalary Range: $120,000.00 - $150,000.00 SalaryJob Category: Information TechnologyPOSITION SUMMARY: This position will be responsible for architecting and designing internal and external products for Allied. Problem solving and finding ways to create scalable software while mentoring junior developers. As a technical lead you will be responsible for resolving issues and ensuring success of projects assigned to your team. ESSENTIAL FUNCTIONS: Collaborate with team comprised of technical and non-technical members to support completion of projects in a timely fashion. Be willing to work on roadmap that includes business and technical initiatives. Provide technical leadership to junior developers. Work with manager and stakeholders to resolve blockers that impact project timelines. Partake in code review to ensure Allied’s code reviews are being adhered to. Work closely with team to design, develop, test, and deploy. Create automated processes to implement/maintain CI/CD pipelines Meet Allied’s expectations for productivity, quality, and goal accomplishment. Work closely with manager to formulate technical strategies for team. Adhere to, and apply all applicable privacy and security laws, including but not limited to HIPAA, HITECH and any regulations promulgated thereto. Perform other duties and responsibilities, as assigned. EDUCATION Bachelor’s degree in Computer Science or Information Technology or equivalent work experience required. Certifications & Licenses: none required, though MCSA, other Microsoft certifications, and HIPAA Awareness/Security are preferred. EXPERIENCE AND SKILLS 7+ years’ experience developing software using Microsoft’s platform required 3+ years in a software developer lead role required Strong understanding of SOLID and OOP. Ability to collaborate well with team members Understanding of SDLC lifecycle Extensive experience coding in C#, ASP.NET/MVC, Web APIs, WCF Experience with SQL Server Development – creating and modifying stored procedures. Display strong technical experience in Microsoft Stack Familiarity to Azure DevOps preferred Familiarity with Azure or AWS cloud environments preferred Familiarity with API Gateway patterns preferred. POSITION COMPETENCIES Job Knowledge Time Management Accountability Communication Initiative Customer Focus PHYSICAL DEMANDS This is an office environment requiring extended sitting and computer work WORK ENVIRONMENT Remote Here at Allied, we believe that great talent can thrive from anywhere. Our remote friendly culture offers flexibility and the comfort of working from home, while also ensuring you are set up for success. To support a smooth and efficient remote work experience, the internet connection must be obtained through a cable broadband or fiber optic internet service provider with speeds of at least 100Mbps download/25Mbps upload. Reliable internet service is essential for staying connected and productive. The company has reviewed this job description to ensure that essential functions and basic duties have been included. It is not intended to be construed as an exhaustive list of all functions, responsibilities, skills, and abilities. Additional functions and requirements may be assigned by supervisors as deemed appropriate. Compensation is not limited to base salary. Allied values our Total Rewards, and offers a competitive Benefit Package including, but not limited to, Medical, Dental, Vision, Life & Disability Insurance, Generous Paid Time Off, Tuition Reimbursement, EAP, and a Technology Stipend. Allied reserves the right to amend, change, alter, and revise, pay ranges and benefits offerings at any time. All applicants acknowledge that by applying to the position you understand that the specific pay range is contingent upon meeting the qualification and requirements of the role, and for the successful completion of the interview selection and process. It is at the Company's discretion to determine what pay is provided to a candidate within the range associated with the role. Qualifications
Oracle Fusion Developer
Allied Consultants, Inc.Allied Consultants, Inc is a proudly Austin based firm with over 34 years of experience delivering top-tier technical and business professionals within Texas State Agencies. Allied Consultants is proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Overview Allied Consultants, Inc is a proudly Austin based firm with over 34 years of experience delivering top-tier technical and business professionals within Texas State Agencies. We are currently seeking an experience Oracle Fusion Developer to play a key role within a high-impact technical services team. At Allied Consultants, we value our consultants and are committed to providing an exceptional experience including: - Highly competitive pay rates - Local support staff for responsive, personal service - Comprehensive benefits package, including: - Medical insurance (with employer cost sharing) - Life insurance - A 401(K) plan with company match - Flexible spending through a cafeteria plan Candidates selected for interviews will be subject to a criminal background check and may be required to pass a drug screening, in compliance with federal and state regulations. All offers of employment are contingent upon successful completion of these checks. Allied Consultants is a proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Responsibilities The Worker(s) will provide the following services: Perform highly complex Systems Analyst work as a member of the IT Enterprise Project Office and Emerging Technologies team, overseeing one or more projects concurrently. Perform technical and analytical work in support of an Oracle Fusion Recruiting Cloud implementation. Extensive hands-on experience in support of Cloud Recruiting implementation, optimization, stabilization, and ongoing operation. This role is the bridge between business stakeholders and technical delivery teams to create a scalable, supportable Recruiting Cloud solution. Analyze system configuration, and confidently guide stakeholders toward standard, sustainable solutions. Coordinate with project teams to identify process issues and work with developers on configuration and design which provide solutions. Work is accomplished in a highly collaborative environment. Perform other duties as assigned to maintain operations. **Location of job: Remote** Qualifications Minimum Requirements: Candidates that do not meet or exceed the minimum stated requirements(skills/experience) will not be considered for this opportunity. Years Skills/Experience 4-7 Experience as a systems analyst in a technical or programmer analyst role with Oracle Fusion Cloud Human Capital Management (HCM). Strong understanding of: Oracle Fusion configuration vs. customization Functional setup tasks and workflows Role-based security concepts 4-7 Hands-on experience in configuration, design, implementation, and production support of Oracle HCM Cloud, with specific experience with the Cloud Recruiting module. 4-7 Skill designing Oracle HCM integrations with other systems, such as with PeopleSoft HCM and mainframe ATS applications for complex real-time and batch data synchronization. 4-7 Oracle integration toolset: including Oracle Integration Cloud (OIC) for API integration, Oracle Data Integrator (ODI) for ETL, and Oracle Managed File Transfer (MFT) for secure file handling 4-7 Experience with vendor management in software project setting. Guide consulting resources and validate the recommended approach and design meets business needs 4-7 Demonstrated ability working with stakeholders and development team; Experience facilitating productive meetings which convert business requirements into technical solutions 4-7 Reporting & Analytics: familiar with custom reports and dashboards using Oracle Transactional Business Intelligence (OTBI) and BI Publisher 4-7 Experience with Oracle updates and patches 4-7 Testing & Validation: experience with user acceptance testing, defect triage, and data validation 4-7 Thorough knowledge of software development life cycle methodologies Preferred Qualifications: Years Skills/Experience 2 Oracle Taleo Applicant Tracking System and Taleo Connect Client (TCC) 2 Certified Oracle Fusion HCM / Recruiting 2 Experience with the Python scripting language 2 Centralized Accounting and Payroll/Personnel System for Texas (CAPPS) 2 Experience with Oracle AI Agents, including leveraging AI-driven capabilities to enhance business process automation, insights, and decision-making
Perception Software Engineering Intern
GlydwaysThe Best Way to Move People High-capacity, on-demand, and affordable mobility
Who we are: Glydways is reimagining what public transit can be. We believe that mobility is the gateway to opportunity—connecting people to housing, education, employment, commerce, and care. By making transportation more accessible, affordable, and sustainable, we empower communities to thrive and unlock economic and social prosperity. Our mission is to revolutionize transit with a solution that delivers high capacity, exceptional user experiences, unmatched affordability, and minimal environmental impact. The Glydways system is a groundbreaking network of carbon-neutral, interconnected transit pathways powered by standardized autonomous vehicles on dedicated roadways. Operating 24/7 with on-demand access, it offers personalized and efficient mobility—without the burden of heavy upfront infrastructure costs or ongoing taxpayer subsidies. With Glydways, we’re building more than a transportation system; we’re creating a future where everyone, everywhere, has the freedom to move. Meet the team: The Glydways perception team is responsible for designing and implementing a perception system that includes data fusion from state-of-the-art sensors (e.g., LIDAR, RADAR, High definition cameras, Ultra-wide-band radios, etc.) and robust detection, classification, and tracking of any and all obstacles that could present a hazard to the vehicle (Glydcars) in the system. The perception system for Glydways will reason about information from each Glydcar and from regularly spaced sensor pods monitoring the road network. The perception team plays a vital role within the Autonomy Software engineering team. The team’s deliverables include: - Documenting a detailed design for enacting a safe system that can be certified by public transportation authorities. - Implementing said design on mature prototype vehicles in demonstrations to customers, potential customers, and investors. - Expanding the design to include fail-operational capabilities that extend the overall system to safely give our customers a more comfortable experience. - Managing data collection, autonomy testing, and milestone demonstration events that showcase the system’s maturing capabilities, leading to a production system. Team members may work remotely and must be self-motivated. About the Role: We are looking for a highly motivated research intern with a strong background in machine learning to join our ML Perception team and apply your expertise to real-world multi agent autonomous driving and infrastructure challenges to help Glydcars see. In this role, you will focus on multimodal efficient deep learning for safety critical systems with built in redundancy and robustness. Collaborating with a multidisciplinary team, you will develop innovative models and algorithms to enhance our perception stack. Roles & Responsibilities: - Implement state-of-the-art onboard multimodal multitask ML perception models, and finetune them to improve performance - Develop custom adaptations (such as layers, loss functions, etc.) to improve performance on our datasetResearch and development in various areas, including multiview sensor fusion for redundancy, robustness, and safety critical operation; and scene understanding with a focus on anomaly detection. - Design and perform experiments, and share and present findings, potentially as a peer-reviewed publication. - Work with multimodal (camera, lidar, radar) datasets from a multiagent autonomous system Knowledge, Skills and Abilities: - Masters / PhD graduating within 12 months of internship completion - Strong programming skills (Modern C++ and/or Python) - Familiarity with deep learning frameworks such as Pytorch - Excellent communication and interpersonal skills; - Strong problem-solving and research skills - Candidates with experience in early fusion models and/or semantic segmentation models are preferred Glydways provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Senior Software Engineer
TopstepTopstep is a business-to-consumer company that aims to democratize the trading industry. In its mission to empower people to pursue their dreams with financial freedom, Topstep off
Summary Are you an engineer who loves building systems that are both powerful and elegant? Topstep is looking for a Senior Software Engineer to own and evolve critical components of our trading platform. In this role, you'll design and build the systems that power real-time trading, market data delivery, and brokerage integrations for thousands of active traders. You'll work in a modern .NET stack, building cloud-native services that handle high-throughput, low-latency workloads. This isn't just about shipping features—you'll shape architectural decisions, establish engineering standards, and ensure our platform scales reliably as we grow. You'll own your systems end-to-end, from initial design through production operations. This role is ideal for someone who combines strong technical depth with pragmatic engineering judgment. You'll balance the need for robust, maintainable systems with the reality of evolving business requirements. You'll contribute to technical strategy, mentor other engineers, and help define what engineering excellence means at Topstep. Key Responsibilities - Design and build services and APIs that power core trading platform capabilities. - Own features end-to-end, from technical design through production deployment, monitoring, and iteration. - Collaborate with product and design to translate user needs into scalable, maintainable technical solutions. - Contribute to system architecture decisions, establishing patterns and practices that other teams can follow. - Write clean, well-tested code with strong focus on reliability, performance, and operational excellence. - Participate in on-call rotations, respond to incidents, and drive continuous improvement of system reliability. - Build and maintain observability into your systems through metrics, logging, and distributed tracing. - Mentor engineers through code reviews, pairing sessions, and sharing knowledge about system design and best practices. - Balance technical debt with feature delivery, making thoughtful trade-offs based on business priorities and technical constraints. - Contribute to engineering culture through documentation, tooling improvements, and process refinements. Required Qualifications and Key Competencies - 5+ years of software engineering experience building and shipping production systems at scale. - Strong proficiency in C# and .NET ecosystem with experience building production services. - Experience designing service boundaries, API versioning, and event-driven patterns in a microservices or modular architecture. - Solid database experience with PostgreSQL or SQL Server, including schema design, query optimization, and understanding of transactional behavior. - Experience with observability tools and distributed tracing in production environments. - Proven track record of owning production systems including monitoring, debugging, and incident response. - Experience with container technologies (Docker) and cloud platforms (AWS). - Strong testing mindset with practical experience across unit, integration, and system testing. - Excellent problem-solving skills with ability to debug complex issues across multiple systems. - Clear communication skills with ability to explain technical concepts to both technical and non-technical audiences. - Comfort working in fast-paced environments with evolving priorities and ambiguous requirements. Nice to Have - Kubernetes experience (EKS or equivalent), Helm, or GitOps (ArgoCD) tooling. - Experience with real-time or async messaging (Redis, NATS, Kafka, etc.) OR real-time comms (SignalR/WebSockets). - Background in high-throughput, low-latency systems or performance optimization. - Distributed tracing and performance tuning in multi-service systems. - Incident leadership (RCA, remediation follow-ups). - Previous work in compliance-constrained environments. - Previous work in financial services, fintech, or compliance-regulated industries. - Understanding of trading systems, market data, or brokerage operation. Company Culture & Perks - Topstep is an engaging working environment which ranges from fully remote to hybrid. We foster a culture of collaboration with cameras on during meetings and a robust Slack environment for communication. - Seven Company-paid Holidays and generous Family Leave. Paid time off is front-loaded. - Competitive 401(k) matching, health, dental, and vision insurance is offered for full time employees. - Vacations are encouraged with a bonus for taking 5 consecutive days. Employee referrals are bonused. Topstep offers a food and groceries budget and contributes towards health and wellness. New Hire Base Salary Range - $175,000-$210,000. - Bonus: This position is eligible for a performance-based bonus as provided by the plan terms and governing documents. - The compensation offered will take into account internal compensation structure and may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. Equal Opportunity Employer Topstep is an Equal Opportunity Employer. We are committed to fostering an inclusive environment where all employees and applicants are valued. All qualified candidates will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, age, disability, or veteran status, in compliance with applicable federal, state, and local laws. Interested in the role? Apply today with your resume!




