• Lead migration of over 100TB of enterprise data from Cloudera Hadoop environments into Google Cloud Platform • Migrate data from HDFS, Hive, AWS S3, and FSx into BigQuery • Validate data integrity throughout migration activities • Optimize storage, performance, and scalability • Design and develop modern cloud-native data pipelines • Build scalable ingestion and transformation frameworks • Develop optimized BigQuery storage models • Support enterprise Data Fabric implementation • Design and implement Medallion Architecture (Bronze, Silver, Gold) • Develop secure and scalable data movement frameworks • Improve platform reliability, performance, and operational efficiency • Support cloud-native data engineering best practices

Business Area: Engineering Seniority Level: Mid-Senior level Job Description: At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. Ready to take cloud innovation to the next level? Join Cloudera’s Anywhere Cloud team and help deliver a true “build your own pipeline, bring your own engine” experience. enabling data and AI workloads to run anywhere, without friction or vendor lock-in. We take the best of the public cloud- cost efficiency, scalability, elasticity, and agility and extend it to wherever data lives: public clouds, private data centers, and even the edge. Powered by Kubernetes, our hybrid architecture separates compute and storage, giving customers maximum flexibility and optimized infrastructure usage. We are looking for a Staff Software Engineer to design and build high-performance infrastructure for Anywhere Cloud (AWC). AWC is Cloudera's Kubernetes-native platform for deploying data services onto any cluster, including air-gapped environments. The systems layer handles credential brokering, protocol-level proxying, request signing, and distributed log collection. These are Rust services deployed on Kubernetes where correctness and latency matter equally. This is not a feature-engineering role. You will own infrastructure where a subtle bug means a security bypass and a naive implementation means unbounded memory growth. You will set the technical direction for performance-critical services, mentor engineers on systems thinking, and provide the low-level capabilities that the rest of the platform depends on. As a Staff Software Engineer you will: - High-Performance Service Development: Build and own Rust-based infrastructure services (reverse proxies, credential brokers, log collectors) that sit in the data path. Ship end-to-end from design doc to production. - Correctness in Security-Critical Code: Implement and verify authentication protocols and access control enforcement. Write thorough tests (including property-based and fuzz testing) for code where bugs have security implications. - Systems Architecture: Design new infrastructure components. Define module boundaries, memory budgets, streaming patterns, and graceful shutdown semantics. Document tradeoffs clearly. - Observability: Build distributed telemetry and log collection systems. Instrument services with structured tracing, metrics, and health endpoints. - Cross-Team Guidance: Be the go-to engineer when other teams need systems-level help. Performance-sensitive design reviews, streaming patterns, caching strategies. - Technical Direction: Drive design documents for new components. Evaluate build-vs-buy decisions. Define testing strategies that give confidence in critical code paths. We’re excited about you if you have: (Minimum Qualifications) - Experience: 8+ years of professional software engineering, with at least 3 years building performance-critical or security-critical systems (proxies, storage engines, network services, or similar). - Rust: You have shipped production Rust services (not just CLIs or libraries). Comfortable with async Rust, multi-crate workspaces, and the tokio/hyper ecosystem. - Systems Fundamentals: Strong understanding of networking (TCP/HTTP), memory management, streaming/backpressure, and concurrency. You can reason about resource constraints and design accordingly. - Security Awareness: Experience working on systems where correctness has security implications. Comfortable reasoning about authentication protocols, input validation, and adversarial edge cases. - Kubernetes: Experience deploying and operating services on Kubernetes. Familiarity with the operator pattern, Helm, and cloud-native infrastructure. - Testing: You go beyond happy-path unit tests. Experience with property-based testing, integration test harnesses, or fuzz testing. - Bsc/Msc in related field or equivalent exerience You may also have: (Preferred Qualifications) - Experience with S3-compatible storage protocols or request signing (SigV4 or similar). - Experience building or operating observability/telemetry pipelines (OpenTelemetry, gRPC, log aggregation). - Prior work on reverse proxies, load balancers, service meshes, or API gateways. - Experience with performance profiling and optimization (flamegraphs, benchmarking, P99 latency work). - Experience building Kubernetes operators or controllers. This role is not eligible for immigration support or relocation. - Why this role matters: This is more than cloud management, it’s about building the foundation for a consistent, secure, and compliant cloud experience that gives organizations 100% access to 100% of their data, anywhere. With the recent acquisition of Taikun, we are simplifying Kubernetes and cloud management even further, creating a platform that is unified, scalable, and future-ready. If you are passionate about Kubernetes, not just using it but building it at the core managing workloads across hybrid clouds and datacenters and obsessed with performance, devops, etc. this is where you belong. What you can expect from us: - Generous PTO Policy - Support work life balance with Unplugged Days - Flexible WFH Policy - Mental & Physical Wellness programs - Phone and Internet Reimbursement program - Access to Continued Career Development - Comprehensive Benefits and Competitive Packages - Paid Volunteer Time - Employee Resource Groups EEO/VEVRAA #LI-AC1 #LI-HYBRID

Role Description The Principal, Cloud Software Engineer will be responsible for designing, developing, and maintaining modern healthcare-focused applications that support clinical, research, and enterprise RnD AAAI initiatives across the RnD organization. This role will lead the development of secure, scalable, AI-enabled web applications and APIs within an AWS cloud environment, with a strong emphasis on product development, user experience, and delivery of intelligent software solutions. - Design, develop, and maintain full stack web applications using Python, Java, C++, and modern frontend frameworks. - Build scalable backend services and APIs using Python frameworks such as FastAPI, Flask, or Django. - Develop responsive, intuitive, and secure user interfaces using React, TypeScript, JavaScript, HTML5, CSS, and Tailwind. - Build healthcare and research applications that support clinical, operational, and AI-enabled workflows. - Collaborate with Product, AI/ML/Data Engineering, IT/Infrastructure, and Business teams to translate requirements into effective software solutions. - Design and develop application features that incorporate AI/ML capabilities. - Integrate AI services and machine learning models into production applications through APIs and service interfaces. - Work with AI/ML teams to support model inference, prompt-based experiences, and AI-powered workflows in healthcare use cases. - Build secure and scalable application components within the AWS environment using services such as EC2, Lambda, ECS/EKS, API Gateway, S3, CloudFront, CloudWatch, and IAM. - Implement authentication, authorization, role-based access, and secure data handling patterns appropriate for regulated healthcare environments. - Develop integrations with internal and external systems using APIs, event-driven patterns, and secure service communication. - Create and maintain automated unit, integration, and end-to-end tests to ensure software quality and reliability. - Support CI/CD practices and modern software delivery workflows using tools such as GitHub Actions, Jenkins, or AWS CodePipeline. - Contribute to application monitoring, logging, and troubleshooting to ensure performance, stability, and maintainability. - Participate in architecture and design reviews, providing input on application structure, scalability, security, and AI integration patterns. - Document application behavior, technical designs, and operational procedures. - Ensure solutions align with healthcare privacy, security, and regulatory expectations including HIPAA, GDPR, and GxP-aligned practices where applicable. - Mentor other engineers and contribute to engineering standards, code quality, and technical best practices. Qualifications - Strong proficiency in Python, Java, C++ development with experience building enterprise or healthcare software applications. - Strong experience with modern frontend frameworks such as React, Angular, or Vue.js. - Experience designing and developing REST APIs and application backends. - Strong understanding of AWS services used for application development and deployment. - Experience building secure, scalable web applications in cloud environments. - Experience with authentication, authorization, and secure application design patterns. - Strong understanding of application testing practices, including unit, integration, and end-to-end testing. - Experience integrating third-party services, APIs, and internal systems. - Experience developing applications that incorporate AI/ML capabilities or intelligent workflows. - Familiarity with AI/ML application patterns such as model inference, LLM integration, prompt-driven experiences, search/retrieval, summarization, or recommendation features. - Experience working with Data Science or ML teams to productionize AI-driven application features. - Knowledge of healthcare privacy, security, and regulatory requirements, including HIPAA and GDPR. - Strong analytical, troubleshooting, and problem-solving abilities. - Excellent communication skills and ability to work effectively with cross-functional stakeholders. - Experience working in Agile/Scrum development environments. Requirements - Preferred Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Data Science, Bioinformatics, Mathematics, or a related technical discipline required. - 5+ years of professional software engineering experience. - 3+ years of experience designing and deploying cloud-native applications within AWS environments. - Demonstrated experience delivering complex software projects from design through production support. Benefits - Eligible to participate in various benefits offerings, including, but not limited to, medical, dental and vision insurance, retirement savings plan, and flexible paid vacation.

• Act as a full stack engineer to build and operate cloud application development and hosting platforms. • Own, develop, implement and operate Allstate’s Cloud platforms. • Collaborate with strategic product teams to define AI strategy. • Prioritize use cases that deliver business value through Google's Vertex AI, AWS and Azure AI Services. • Split time evenly in executing operational tasks and engineering new solutions to automate tasks. • Provide in-depth expertise in GenAI on Azure and AWS cloud platforms. • Recommend integration strategies, enterprise architectures and application infrastructure.