Job Closed
This listing is no longer active.
Our mission is to enable effortless credit based on true risk.
Senior Software Engineer, LLMs
Location
United States
Posted
104 days ago
Salary
$167.7K - $231.8K / year
Seniority
Senior
Job Description
Senior Software Engineer, LLMs
Upstart
• Design and build user-facing ML features that harness LLMs and generative AI to unlock new product capabilities • Partner with product, design, and ML research to prototype and deliver high-impact, ML-powered experiences • Own the technical architecture and implementation strategy for applied ML systems - balancing latency, observability, and iteration speed • Build scalable services and APIs that bring model outputs to users in trustworthy and intuitive ways • Collaborate across platform, infra, and legal/compliance teams to ensure ML deployments meet standards for safety, fairness, and performance • Establish and evangelize best practices for prompt design, model evaluation, and experimentation across the org
Job Requirements
- 4+ years of software engineering experience, with 2+ years working directly on ML-driven products or intelligent systems
- Proven ability to lead complex initiatives across engineering, product, and research stakeholders
- Strong backend development skills (e.g., Python with FastAPI or Flask), plus experience with cloud-native tooling (e.g., Kubernetes, Docker, Terraform)
- Experience integrating LLMs or ML models into production systems, including APIs and user-facing applications
- Excellent communication skills and a collaborative, product-minded approach
- Ability to think rigorously about system design, latency tradeoffs, and user impact when working with ML features
- Experience shipping GenAI or LLM-powered features using frameworks like LangChain, LlamaIndex, or OpenAI APIs
- Familiarity with retrieval-augmented generation (RAG), vector search (e.g., FAISS, Pinecone), and real-time inference patterns
- Proficiency in full-stack development, including front-end work with React or similar frameworks
- Strong intuition for prompt engineering, model testing, and evaluation methodologies
- Experience navigating complex requirements around explainability, user trust, or compliance in ML applications
- Track record of influencing architecture or product direction at a team or org level
Benefits
- Competitive compensation, including base pay, bonus opportunities, and annual equity grants that vest quarterly
- Generous 401(k) plan with Upstart matching $2 for every $1 contributed, up to $15,000 per year
- Employee Stock Purchase Plan (ESPP) with discounted stock purchase options for eligible employees
- Affordable medical, dental, and vision coverage, with multiple plan options - Upstart covers 90% to 100% of the cost depending on the plans you choose
- Health Savings Account contributions from Upstart for eligible plans
- Income protection benefits, including company-paid Basic Life, AD&D, and Short- and Long-Term Disability coverage, with options to purchase supplemental coverage
- Paid time off, sick and safe time, and company holidays
- Paid family and parental leave to support caregiving and major life moments
- Family-centered benefits through Carrot and Cleo, supporting fertility, parenthood, and caregiving
- Employee Assistance Program (EAP) offering mental health support and life-centered resources
- Financial wellness resources, including access to financial planning tools and a financial concierge service
- Annual wellness allowance to support your physical and emotional well-being and personal development, based on what matters most to you
- Annual productivity allowance to invest in relevant tools and resources you need to do your best work, no matter where you work from
- Connection and community through team events and onsites, all-company updates, and employee resource groups (ERGs)
- Onsite perks, including catered lunches and fully stocked micro-kitchens when working from one of our four offices, located in the Bay Area, Austin, Columbus, and New York City (opening Summer 2026!).
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Build and maintain mobile applications for iOS and Android • Implement responsive, polished UI aligned with design specifications • Translate Figma or design files into clean, maintainable code • Optimize performance, responsiveness, and stability across devices • Manage application state and component architecture • Integrate mobile apps with backend services and APIs • Handle authentication, data synchronization, and error handling • Implement secure and scalable data flows • Integrate third-party SDKs and services as needed • Maintain version control and clean code practices • Support app deployment to App Store and Google Play • Debug issues, monitor performance, and resolve crashes • Write and maintain unit and integration tests • Implement platform-specific features and enhancements • Optimize onboarding, navigation, and user flows • Ensure compatibility with OS updates and device variations • Manage permissions, notifications, and deep linking • Collaborate with product, design, and engineering teams • Participate in sprint planning, reviews, and retrospectives • Communicate progress, risks, and trade-offs clearly • Contribute to documentation and shared engineering standards
• Build and maintain responsive, performant web applications using TypeScript, React.js, and Next.js • Translate Figma designs into pixel-perfect, functional UI components with attention to detail • Own feature delivery across web applications focusing on component velocity and modular architecture • Implement UI component standardization and design system consistency • Optimize frontend performance for speed, accessibility, and user experience • Build responsive interfaces that work seamlessly across devices and browsers • Collaborate closely with design teams to align on UX/UI best practices • Ensure polished, production-ready solutions with strong attention to detail • Implement frontend testing strategies using Jest, Cypress, or equivalent frameworks • Design and implement backend systems using Node.js, Golang, TypeScript, or other compiled languages (Java, C#) • Architect robust, scalable backend solutions following best practices and clean code principles • Design efficient database structures and queries for SQL databases (PostgreSQL, MySQL) and NoSQL systems (MongoDB) • Build and maintain RESTful APIs with proper error handling and documentation • Implement third-party API integrations including payment gateways and external services • Optimize backend performance, scalability, and reliability across high-traffic systems • Support and optimize data pipelines using Python for automation and data processing • Ensure robust, maintainable, and scalable architecture across all backend systems • Implement security measures, authentication, and authorization protocols • Implement and maintain CI/CD pipelines for automated testing and deployment • Work with cloud infrastructure (AWS, GCP, Vercel, Railway) for hosting and scaling • Manage Dockerized local development environments and containerization strategies • Conduct unit, integration, and end-to-end testing to ensure code quality • Implement monitoring, logging, and performance tracking systems • Manage version control workflows using Git/GitHub with proper branching strategies • Optimize applications for performance, security, and scalability • Troubleshoot production issues and implement solutions quickly • Participate in end-to-end product development from ideation through deployment • Partner with cross-functional teams (Product, Design, Data, Leadership) to align on goals and technical solutions • Conduct and participate in code reviews maintaining high engineering standards • Communicate progress clearly and manage deadlines across stakeholders in remote-first setups • Write clean, maintainable, well-documented code following best practices • Contribute to continuous improvement of engineering standards, tooling, and processes • Mentor junior engineers and share knowledge across the team • Provide technical insights and progress updates to leadership and stakeholders
Account Technical Lead, Enterprise Accounts
AutodeskHow the world gets designed and made. #MakeAnything
• Drive end-to-end technical discovery across multiple workflows, systems, and disciplines • Identify transformation opportunities that align Autodesk technology to customer objectives • Architect advanced, multi-solution technical proposals and deployment paths • Build and maintain deep, long-term relationships with technical and business stakeholders • Develop and maintain a detailed Customer Technical Vision (CTV) • Proactively identify multi-solution expansion opportunities to drive revenue growth • Lead complex technical escalations requiring cross-functional coordination • Collaborate with Account Executives to shape opportunity strategy using technical insights • Orchestrate internal specialists for demonstrations, benchmarking, and technical workshops • Provide clear, data-driven analysis of evaluation outcomes and performance results • Represent Autodesk in enterprise events and industry discussions
Staff Software Engineer
Omada HealthA digital-first chronic care provider, helping members change mindsets to improve health and build lasting change.
• Lead architecture, system design and engineering efforts for high-scale, data-intensive B2B systems supporting eligibility, billing, marketing, and file ingestion. • Design and implement batch and real-time processing architectures that are reliable, observable, and performant. • Drive efforts in database performance optimization, schema design, and long-term scalability planning across multi-terabyte PostgreSQL and other persistent stores. • Partner closely with product, infrastructure, and operations teams to deliver resilient, maintainable systems that balance business needs with technical excellence. • Identify and lead engineering-wide initiatives that improve scalability, developer efficiency, or data quality. • Mentor and coach engineers at all levels, and actively contribute to Omada’s engineering community through design reviews, technical talks, and shared best practices. • Contribute to modern, cloud-forward architecture across multiple product domains, ensuring our systems are designed to evolve gracefully and scale efficiently. • Use and advocate for AI-assisted development tools (e.g., Cursor, Claude) to enhance individual and team productivity. • Champion a culture of quality, observability, and reliability through strong DevOps principles and continuous improvement.



