Job Closed
This listing is no longer active.
Knowledge is the best medicine.
AI/LLM Engineer
Location
United States
Posted
173 days ago
Salary
$159.3K - $202.4K / year
Seniority
Senior
Job Description
AI/LLM Engineer
Ostro
• Develop performant, scalable, and high quality APIs and backend processes for Ostro's SaaS platform, with a strong emphasis on LLM integration. • Collaborate with cross-functional teams to implement new features and refine existing ones, particularly those involving AI/LLM capabilities. • Provide feedback on roadmap and features for your team, contributing to the strategic direction of Ostro’s AI/LLM initiatives. • Ensure code quality and compliance through thorough reviews, unit testing, and adherence to best practices for LLM-powered applications and Ostro engineering. • Optimize application performance and scalability to meet user demands, especially for LLM inference and data processing. • Stay informed about emerging AI/LLM technologies, prompt engineering techniques, and industry trends. • Troubleshoot and resolve production issues, ensuring performance, reliability, and scalability of LLM-driven features.
Job Requirements
- Experience shipping LLM pipelines including preprocessing, prompt optimization, output validation, and fallback mechanisms
- Experience with production use of LLM APIs (e.g., OpenAI, Gemini)
- Experience building systems to measure model performance, detect drift, and ensure output quality in production environments.
- Proficiency in prompt engineering and/or have developed systematic approaches to prompt design
- Proficiency with Python and Django (or similar frameworks)
- Strong collaboration and communication skills in cross-functional environments
- Bachelor’s degree in computer science or related field, or equivalent work experience
- 3+ years of experience as a Software Engineer
Benefits
- Impacting the future of healthcare - your innovations could very likely become the new norm for millions of people.
- Working alongside the founders of the company. If you have any entrepreneurial desire to start your own company in the future, you will see first-hand what it takes.
- 100% fully remote but with frequent opportunities to collaborate in-person.
- Technology & office setup reimbursement.
- Freedom and responsibility to structure your work as you desire. We measure output and results and believe freedom allows for maximum ability.
- Unlimited PTO, plus two extended company-wide closures per year!
- Family leave: up to 10 weeks of 100% paid salary.
- Open communication - we believe in being transparent and radically honest with no retaliation.
- Competitive salary and equity.
- Medical/dental/vision benefits and more.
Related Guides
Related Job Pages
More LLM Engineer Jobs
• Build and improve agentic workflows (tool/function calling, planning, self-checks) for analytics, summaries, visualizations, and task automation. • Implement adapters and tools to connect LLMs with internal and external services. • Contribute to our FastAPI backend with clean interfaces, Pydantic validation, and tests. • Develop evaluation metrics to measure accuracy, latency, and cost. • Optimize prompts, retrieval/contexting, and execution strategies for privacy, reliability, and performance. • Ship services in containers (Docker) and collaborate on deployments (Kubernetes), CI, and observability. • Document technical decisions and share learnings with the team.
