Roboflow logo
Roboflow

Making computer vision easy to use for developers.

Machine Learning Engineer - Inference Maintainer & Developer Experience

Machine Learning EngineerMachine Learning EngineerFull TimeRemoteMid LevelTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

Northern America + 1 moreAll locations: Northern America | Europe

Posted

10 days ago

Salary

0

Seniority

Mid Level

No structured requirement data.

Job Description

Machine Learning Engineer - Inference Maintainer & Developer Experience

Roboflow

Role Description Inference is growing fast — and so is the volume of contributions, increasingly authored with the help of AI agents. That's a great problem to have, but it's outpacing our ability to keep quality high and cut releases on a predictable cadence. Today we ship roughly weekly, and it's a fight. We want to flip that equation. The goal is to build and continuously evolve an agentic-driven contribution and release pipeline — automated and semi-automated review, triage, CI/CD, and end-to-end testing — so that we can safely absorb a high volume of agent-generated PRs while staying firmly in control of quality. The ideal end state: nightly end-to-end tests across every target (both standalone and on-platform), backed by a growing, world-grounded suite that validates the real health of every build. With that foundation, daily releases become routine, and we can say "yes" to far more contributions without ever lowering the bar — pushing back, by design, according to strictly defined review standards. Alongside that, this person becomes the human face of inference: teaching internal teams and customers how to get more out of it, partnering with marketing to tell its story, and owning the (genuinely fun) work of bringing new models into the engine. Qualifications - 5+ years of hands-on experience building and operating production-grade ML systems, ideally involving large-scale deployment of modern AI models. - A real CV/ML foundation — understanding how computer vision models work internally and how to adapt them for real-world, high-impact use. - Stellar agentic skills — fluently building with AI coding agents and automating the engineering process itself. - Strong CS and systems background, with the ability to independently tackle complex programming, architecture, and reliability challenges. - Hands-on experience with CI/CD, release engineering, and test infrastructure. - Practical expertise with core ML technologies, including PyTorch, TensorFlow, ONNX, TensorRT, vLLM, etc. - Strong proficiency in image and video processing, including OpenCV, DeepStream, Pillow, PyAV, etc. - Excellent communication and soft skills — able to teach, write clearly, and collaborate across teams. - Open source maintenance experience is a strong plus. Requirements - Build and maintain inference, our flagship open source and commercial CV inference engine. - Build an agentic-driven contribution pipeline — automated and semi-automated review, triage, and CI/CD. - Design and grow a world-grounded, ever-expanding test suite that validates real build health across every target. - Define and enforce the "rules of the road" — the review standards and skills that agents and contributors must follow. - Streamline how new models get added to inference. - Teach and enable internal teams and customers. - Be the bridge between core engineering and clients — translating new capabilities into docs, demos, stories, and launches. - Contribute to and grow the broader open source community around the project. Benefits - $4000/yr Travel Stipend to travel anywhere anytime to work alongside other Roboflowers. - $350/mo Productivity stipend for enhancing work environment. - $350/mo AI Tools stipend. - Cover up to 100% of your health insurance costs for you and your partner or family. - $150/mo team lunch stipend. - Remote first/flexible schedule allowing collaborative work. - Unlimited PTO with an annual 2 week minimum. - 12 weeks parental leave. - Equity in the company. Interview Process - Before the Interview: Review of application, LinkedIn, Github, etc. - Introduction Phase: Technical Assessment [15m]. - Team Interview Phase: - Live coding [45m]. - Home assignment [30m]. - Meet with Inference Core team member [60m]. - Meet with hiring manager. - Final Interview Stage: - Meet with Head of Operations for a culture discussion [45m]. - Meet with CEO [30m].

Related Job Pages

More Machine Learning Engineer Jobs

OpenTeams logo

Senior Machine Learning Engineer

OpenTeams

OpenTeams is your single source for everything open source.

Full TimeRemoteTeam 11-50H1B No Sponsor

• Develop and refine features for deep learning models, working with large-scale customer and behavioral datasets • Implement model architecture changes informed by recent academic research (e.g., papers from NeurIPS and similar venues) • Collaborate with client teams to understand business context and translate requirements into technical solutions • Optimize model training pipelines for efficiency and scalability • Document approaches, findings, and technical decisions for knowledge sharing across teams • Participate in code reviews and contribute to engineering best practices

Texas
$145K - $250K / year
Optum logo

Principal AI / Machine Learning Data Engineer - Remote or hybrid from MN or DC

Optum

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

Full TimeRemoteTeam 160,000Since 2011

Requisition Number: 2373757 Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. The Enterprise Information Security (EIS) team is responsible for cybersecurity across our organization. We support our business and members by reducing risk, rapidly responding to threats, focusing on business resiliency and securing new acquisitions. The Principal AI Data Engineer will design and build end-to-end AI pipelines for large-scale unstructured data, enabling advanced analytics, Generative AI, and investigative insights. This role will transform raw, complex datasets-such as scanned documents, images, PRFs and other OCR- driven unstructured data sources-into AI-ready, searchable, and model-integrated data products. You will play a key role in building LLM-powered systems (e.g., RAG, semantic search, summarization, and insight extraction) and scaling them into production environments. This position sits at the intersection of data engineering and AI, with an emphasis on building modern data pipelines and enabling production-grade AI capabilities. You'll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week. Primary Responsibilities: - Design, develop, and maintain scalable data pipelines and data platforms supporting analytics, machine learning, and AI use cases - Build and optimize ingestion frameworks for large-scale structured and unstructured data, including streaming and event-driven sources - Partner with cross-functional stakeholders to understand evolving data and AI needs and define long-term technical solutions - Enable and support machine learning and AI workflows, including feature engineering, data preparation, and model deployment support - Drive strategic initiatives around Generative AI, data quality, observability, lineage, and governance - Develop and maintain frameworks that support rapid experimentation and deployment of AI/ML solutions - Introduce and evolve best practices in data modeling, orchestration, testing, and monitoring - Identify and champion opportunities for platform scalability, performance optimization, and cost efficiency - Collaborate with product, analytics, and infrastructure teams to deliver high-impact data and AI solutions - Build and maintain reusable parsing, enrichment, analytic, and service libraries to accelerate delivery across teams - Work comfortably under time-sensitive conditions while ensuring thoroughness - Maintain high ethical standards and the ability to remain objective and confidential - You will be building and operating production data platforms and pipelines across batch and streaming workloads - Working hands-on engineering in Python and SQL; in a JVM languages (Java/Scala) Spark ecosystems - Distributed processing and lakehouse/warehouse patterns (eg, Spark/PySpark, Databricks, Snowflake) - Build pipelines for OCR, document parsing, and text extraction from image-based or scanned data sources - Enabling Generative AI solutions in production (eg, RAG-style architectures), including retrieval patterns and evaluation/monitoring practices - Take a knowledge-centric data approaches (eg, metadata-driven systems, entity resolution, and/or graph concepts) to improve discoverability and downstream analytics - Data quality, observability, and monitoring mindset (profiling, validation, alerting, and reliability improvements) - Orchestrate, CI/CD, containerization, and infrastructure-as-code (eg, Airflow, GitHub Actions, Docker, Terraform, Kubernetes) - Work in the Cloud (AWS, Azure, and/or GCP), including secure handling of sensitive data (PII/PHI) and collaboration with compliance partners - Lead through influence, mentor engineers, and translate ambiguous problems into scalable technical roadmaps You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in. Required Qualifications: - Bachelor's degree or equivalent experience - 5+ years of experience designing, building, and operating scalable data pipelines and platforms (batch + streaming) - 2+ years of experience deploying Generative AI solutions to production (e.g., RAG, LLM-powered pipelines, semantic search) - Proven solid hands-on development in Python and SQL, with experience in Spark/PySpark and Databricks (or similar distributed platforms) - Experience building ingestion and processing frameworks for unstructured data (OCR, documents, images), including parsing and enrichment - Experience with cloud platforms (AWS/Azure/GCP), DevOps/CI/CD, and infrastructure-as-code, including secure handling of sensitive data (PII/PHI) - Proven ability to design scalable solutions, implement data quality/observability practices, and collaborate across stakeholders Preferred Qualifications: - Experience with cloud platforms such as AWS, Azure, or Google Cloud, including managed data services - Experience with streaming and event-driven architectures (e.g., Kafka, Kinesis, Event Hubs) - Experience with data quality and validation frameworks (e.g., Great Expectations, Deequ) and/or data observability tooling - Experience enabling MLOps practices (e.g., feature stores, model registries, experiment tracking, deployment automation) - Experience with lakehouse architectures, Delta Lake, and advanced Spark optimization/performance tuning - Experience with data visualization tools and libraries such as Plotly, seaborn, and Chartjs - Experience with machine learning and predictive analytics - Familiarity with security and privacy concepts for data platforms (e.g., least privilege, PII/PHI handling) and working with compliance partners - Solid hands-on engineering in Python and SQL; familiarity with JVM languages (Java/Scala) in Spark ecosystems *All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $112,700 - $193,200 annually based on full-time employment. We comply with all minimum wage laws as applicable. Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants. At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment. #BI-Hybrid

Minnesota
$112.7K - $193.2K / year
Job Closed
Full TimeRemoteTeam 1,001-5,000Since 1979H1B Sponsor

• Design and build automated deployment pipelines specifically for generative AI applications • Ensure that updates can be safely promoted across environments (Dev, Test, Prod) • Deploy and manage the infrastructure required for continuous AI evaluation • Instrument AI applications to capture deep operational metrics • Implement version control for prompts and model configurations • Integrate input/output guardrails into the application flow to automatically block prompt injection attacks, PII leakage, or off-topic responses • Actively monitor the financial footprint of AI solutions

United States
$155K - $195K / year
NBCUniversal logo

Tech Lead, ML Infrastructure

NBCUniversal

Here you can create the extraordinary. Join us.

Full TimeRemoteTeam 10,001+Since 2004H1B Sponsor

• Steward the end-to-end planning, execution, and delivery of the data and training infrastructure for the organization. • Act as the primary point of contact for the team that serves infrastructure to multiple other machine learning teams. • Own the cloud spend and implement cost-tracking, resource allocation and lifecycle management. • Service mindset in making the day-to-day of ML engineers smooth, balancing engineering rigor with ease of use.

New York + 1 moreAll locations: New York | Mali
$245K - $270K / year
Job Closed