RxSense logo
RxSense

Advanced Technologies. Powerful Results.

Principal AI Ops Engineer

AI EngineerMachine Learning EngineerFull TimeRemoteLeadTeam 201-500H1B SponsorCompany SiteLinkedIn

Location

New York

Posted

1 day ago

Salary

$190K - $225K / year

Seniority

Lead

Bachelor Degree6 yrs expExperience acceptedEnglishAWSPythonTypeScript

Job Description

Principal AI Ops Engineer

RxSense

• Build and maintain end-to-end deployment pipelines for AI-powered applications, including artifact builds, environment promotion, rollback, and observability hooks. • Stand up and operate the runtime and lifecycle infrastructure for production agents, including deployment, versioning, monitoring, rate-limiting, and retirement. • Own how the organization provisions, rotates, scopes, and meters access to model provider APIs (Anthropic, OpenAI, and others). • Build evals into the CI/CD pipeline so no agent or LLM-powered service ships without passing a defined eval bar. • Stand up self-hosted inference for workloads where managed APIs aren't the right fit. • Design and build the shared developer harness that every AI-powered service uses. • Partner with finance on cost visibility, including token accounting and per-feature cost attribution. • Write documentation, runbooks, and clear interfaces. • Participate in code review and promote collaboration and best practices.

Job Requirements

  • BS (or higher, e.g., MS or Ph.D.) in Computer Science or related technical field involving coding, or equivalent technical experience.
  • 6+ years of platform, infrastructure, or DevOps engineering, with at least 2 years building production infrastructure for AI/ML or LLM-powered systems.
  • Deep hands-on experience designing and operating CI/CD pipelines for high-velocity engineering organizations, including artifact management, environment promotion, and progressive rollout.
  • Strong AWS background, comfortable down to the IAM, networking, and container orchestration layers.
  • Proven track record building developer platforms or internal tools that other engineering teams adopted by choice, not by mandate.
  • Production experience with LLM-powered applications, including prompt management, model routing, retries, tracing, and the operational realities of running agents or chains in production.
  • Hands-on coding fluency in Python or TypeScript, ideally both.
  • Comfortable operating in a polyglot environment.
  • Comfortable owning the cost and reliability conversation with both engineering leadership and finance partners.
  • Strong written communication and a bias toward documentation, runbooks, and clear interfaces.
  • Proven analytical thinking and problem-solving skills.
  • Excellent communication skills, both verbal and written.

Benefits

  • RxSense believes that a diverse workforce is a more talented and productive workforce. As such, we are an Equal Opportunity and Affirmative Action employer. Our recruitment process is free from discriminatory hiring practices and all qualified applicants are considered for employment without regard to race, color, religion, sex, gender, sexual orientation, gender identity, ancestry, age, or national origin.
  • Neither will qualified applicants be discriminated against on the basis of disability or protected veteran status.
  • We believe in the strength of the collaboration, creativity and sense of community a diverse workforce brings.

Related Job Pages

More AI Engineer Jobs

Qualysoft logo

AI Engineer – Automotive

Qualysoft

Qualysoft is a one-stop shop for IT services and digitizing your business needs.

AI Engineer1 day ago
Full TimeRemoteTeam 501-1,000Since 1999H1B No Sponsor

• Drive the architecture, development and optimization of (generative) AI applications with a strong focus on model evaluation, retrieval-augmented generation (RAG), and prompt engineering. • Implement end-to-end RAG pipelines (ingestion, chunking, embeddings, retrieval, re-ranking) and integrate them with internal data sources. • Design and integrate data storage for AI applications using vector search in Snowflake and relational databases such as PostgreSQL. • Analyze and integrate data from various sources, ensuring high data quality and preparing it for effective AIdriven solutions. • Experiment with LLM models (e.g. OpenAI, Anthropic, Azure OpenAI) to improve performance, reliability and applicability across business use cases. • Establish and maintain robust engineering practices for GenAI applications (testing, observability, security, performance optimization). • Collaborate closely with our AI platform team to enhance, standardize and scale AI-driven capabilities across the BMW Group. • Work closely with different business units, helping them leverage AI models for real-world applications and continuous improvements. • Share your expertise in Generative AI, LLM orchestration, and software engineering with other teams, contributing to knowledge-sharing and innovation within the organization.

Romania
Jamf logo

Software Engineer II, AI Initiatives

Jamf

The Standard in Apple Enterprise Management

AI Engineer1 day ago
Full TimeRemoteTeam 1,001-5,000Since 2002H1B Sponsor

• Break down customer problems into work you and the team can execute on. • Independently complete a majority of identified tasks from start to finish with high quality. • Use your knowledge of product to mentor others. • Use your knowledge of Engineering best practices to ask the right questions, solve problems and build great software. • Clearly communicate technical concepts with others in the organization (Technical Communication, Support, Product and Cloud). • When you don’t know the solution, seek out the appropriate people in the organization for advice. • Performs all job responsibilities in alignment with the core values, mission and purpose of the organization. • Adheres to the highest moral, ethical and legal standards to deliver an environment that promotes respect, innovation and creativity. • Supports and promotes a positive, inclusive workplace one in which the talents and strengths of our increasingly diverse workforce are welcomed, further developed and manifested in our work.

Poland
Jamf logo

Senior Software Engineer, AI Initiatives

Jamf

The Standard in Apple Enterprise Management

AI Engineer1 day ago
Full TimeRemoteTeam 1,001-5,000Since 2002H1B Sponsor

• Break down customer problems into work you and the team can execute on. • Independently complete tasks from start to finish with high quality. • Ability to communicate technical concepts to stakeholders. • Use your knowledge of Engineering best practices to ask the right questions, solve problems and build great software with a high level of quality. • Produce designs for new and existing features. • Clearly communicate technical concepts with others in the organization (Technical Communication, Support, Product and Cloud). • Perform all job responsibilities in alignment with the core values, mission and purpose of the organization. • Adhere to the highest moral, ethical and legal standards to deliver and environment that promotes respect, innovation and creativity. • Support and promote a positive, inclusive workplace one in which the talents and strengths of our increasingly diverse workforce are welcomed, further developed and manifested in our work.

Poland
E. Breuninger GmbH & Co. logo

AI Engineer

E. Breuninger GmbH & Co.

Breuninger ist der führende Fashion und Lifestyle Department Store im Premium und Luxussegment und seit 140 Jahren am Markt. Europaweit ist der Breuninger Online-Shop der wichtigste Kontaktpunkt mit unserer Plattform und bietet auch stationär eine stetig wachsende Anzahl von digitalen Touchpoints für unsere Kund:innen. Bei unserer Technologie glauben wir an "you build it you run it" und betreiben unsere vertikalisierte Multichannel-Plattform auf AWS. Die Software-Architektur verantworten unsere Teams selbst. Bei uns arbeitest du Cloud native und bist Hacker:in und Teamplayer:in zugleich.

AI Engineer1 day ago
Full TimeRemoteTeam 5,001-10,000

Role Description Als Applied AI/ML Engineer im zentralen Data Science Team bringst Du moderne AI-Technologien in produktive Anwendungen. Du entwickelst robuste, skalierbare und verantwortungsvoll nutzbare AI-Lösungen, die unseren Führungsanspruch im Bereich Fashion & Lifestyle als internationaler Omnichannel Department Store weiter stärken. - Du entwickelst AI-gestützte Anwendungen und Workflows von der Idee bis zum produktiven Einsatz – und triffst dabei pragmatische Entscheidungen zwischen Anwendungsqualität, Latenz, Zuverlässigkeit und Kosten. - Du integrierst Large Language Models, MCPs/APIs, RAG-Ansätze und Automatisierungen sinnvoll in bestehende Produkte und Prozesse und lernst kontinuierlich aus echten Nutzersignalen statt nur aus sauberen Benchmarks. - Du baust zuverlässige AI/ML-Pipelines auf und unterstützt Evaluation, Monitoring und Qualitätssicherung. - Du arbeitest eng mit Data Scientists, Cloud Engineers, Product Owners und Fachbereichen zusammen, um messbaren Mehrwert aus AI-Technologien zu schaffen und die zukünftige technische Ausrichtung mitzugestalten. Qualifications - Du hast ein Studium oder vergleichbare Erfahrung in Informatik, Data Science, Mathematik, Wirtschaftsinformatik oder einem ähnlichen technischen Bereich. - Du bringst fundierte Kenntnisse in Python mit und kannst auch komplexe Datenbankabfragen mit SQL sicher gestalten. - Du bringst Erfahrung in der Entwicklung und Operationalisierung von ML- oder GenAI-Lösungen mit. - Du hast Cloud- und MLOps-Erfahrung, zum Beispiel mit GCP oder MLflow, und nutzt Python sicher für Data Preparation, Evaluation und ML-Grundlagen. - Du bist sicher im Umgang mit GenAI-Ansätzen wie LLMs, RAG, LangChain/LangGraph sowie AI APIs und LLM-basierten Pipelines. - Du hast ein gutes Verständnis für die Architektur von AI-Lösungen. Kenntnisse in MCP/A2A/A2UI/AG-UI und Multi-Agent-Patterns sind ein Plus. - Du denkst lösungsorientiert, pragmatisch und nutzerzentriert – und möchtest AI wirksam in Produkte und Prozesse bringen, statt nur damit zu experimentieren. - Du bist mit agilen Arbeitsweisen vertraut und arbeitest gerne interdisziplinär mit technischen und fachlichen Partnern zusammen. - Du verfügst über verhandlungssichere Englischkenntnisse; Deutschkenntnisse sind von Vorteil. Benefits - Freiwilliges Urlaubs- und Weihnachtsgeld sowie Zuschüsse zur Altersvorsorge. - 30 % Mitarbeitendenrabatt, auch für Deine:n Partner:in, inklusive Gastronomie und Friseur. - Ab dem 5. Jahr erhältst Du zusätzliche Urlaubstage. - Zuschuss zu Deiner Urban Sports Mitgliedschaft. - Von Trainings bis zu Führungsprogrammen. - Bis zu 30 Kalendertage im Jahr in ausgewählten europäischen Ländern. - Über Gehaltsumwandlung kannst Du Dir zusätzliche Urlaubstage sichern, ergänzt durch Sabbatical-Option. - Mit Company Bike Dein Wunschrad oder E-Bike unkompliziert leasen.

Europe