Unifying and automating referral workflows so that every patient reaches the right provider at the right time and cost.
Senior Backend AI Engineer
Location
New York
Posted
133 days ago
Salary
$180K - $240K / year
Seniority
Senior
Job Description
Senior Backend AI Engineer
Arbiter
• Design, build, and operate the backend AI systems that power Arbiter’s intelligent care orchestration platform. • Own critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration. • Ship and maintain production-grade AI systems that automate complex clinical and administrative workflows. • Contribute to the architectural design of Arbiter’s AI-driven platform, emphasizing modularity and scalability. • Ensure high performance, low latency, and fault tolerance across backend services and AI inference pipelines. • Implement and uphold best practices for CI/CD, testing, observability, and deployment of backend and AI systems. • Partner closely with data scientists, product managers, clinical experts, and other engineers. • Mentor engineers, contribute to internal documentation and standards, and raise the overall engineering bar. • Take end-to-end ownership of critical systems, including participating in on-call rotations.
Job Requirements
- 5 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments.
- Computer Science or Engineering degree, or equivalent practical experience.
- Experience building and maintaining large-scale Python codebases with strong opinions on structure, quality, and tradeoffs.
- Proven experience designing and operating complex backend systems in production.
- Deep understanding of concurrency, scalability, reliability, and distributed systems patterns.
- Hands-on experience with async or event-driven architectures.
- Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility.
- Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments.
- Experience building and shipping AI-powered systems beyond prototypes or internal demos.
- Strong communication skills and ability to work effectively across functions.
Benefits
- Highly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.
- Generous Paid Time Off (PTO): To ensure a healthy work-life balance.
- Comprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.
- Life and Disability Insurance: Providing financial security.
- Simple IRA Matching: To support your long-term financial goals.
- Professional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.
- Wellness Programs: Initiatives to support your physical and mental health.
Related Guides
Related Job Pages
More Backend Engineer Jobs
• Design, build, and maintain robust backend services using Java and Spring Boot. • Contribute to a modern microservices architecture deployed in the cloud. • Collaborate closely with product, architecture, and engineering teams to deliver scalable, resilient, and high-quality solutions. • Ensure performance, reliability, and seamless integration across distributed systems.
• Develop and maintain backend systems and core application components • Collaborate with cross-functional teams to design scalable and high-performance solutions
Director of Software Engineering, Java, Streaming
FICOFICO is an analytics company helping businesses make better decisions that drive higher levels of growth and success.
• Collaborate with product managers to understand priorities and usage scenarios of product features. • Work with stakeholders to comprehend and provide feedback on requirements for your software platform capability. • Provide leadership to your team to ensure positive customer outcomes, aligned autonomy, a spirit of innovation, a bias for action, clear and transparent communication, community of trust, and commitment to move forward together. • Collaborate with other engineering leaders and cross-functional groups to ensure that the entire streaming platform is a success. • Continuously improve engineering practices for the software platform to support efficiency, reliability, and serviceability goals. • Coach and motivate your leaders and engineers to excel in their roles while fostering a learning culture. • Hire the best talent for your teams. • Participate in prospect/customer meetings on technology topics. • Participate in support activities for both cloud and on-premises implementations.
• Design and implement high-performance Golang microservices for e-commerce checkout, account management, and fraud mitigation. • Take ownership of components and features within backend systems, ensuring reliability, scalability, and maintainability. • Build, test, monitor, and maintain critical integrations and infrastructure. • Develop and support robust internal and external APIs with high throughput and low latency requirements. • Collaborate closely with Product, Design, and Data teams to deliver technical solutions aligned with user and business goals. • Participate in code reviews, share knowledge with teammates, and uphold engineering best practices. • Drive projects from implementation to production deployment with a focus on quality and operational readiness. • Contribute to ongoing improvements in system performance, observability, and CI/CD workflows. • Explore and help implement AI-powered capabilities within our systems and workflows, including agentic tools and intelligent automation. • Support a collaborative, inclusive engineering culture through thoughtful communication and continuous improvement.
