Egen logo
Egen

Engineering new possibilities with platforms, data, and generative AI

Lead Machine Learning Engineer, Inference – Performance

Machine Learning EngineerMachine Learning EngineerFull TimeRemoteSeniorTeam 501-1,000Since 2000H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

9 days ago

Salary

$159.3K - $250.1K / year

Seniority

Senior

Bachelor Degree5 yrs expEnglishSQL

Job Description

Lead Machine Learning Engineer, Inference – Performance

Egen

• Optimize Inference: Build and tune production LLM serving with vLLM and SGLang • Profile & Accelerate Training: Instrument and profile training runs to find bottlenecks • Engineer for the Hardware: Apply a working understanding of GPU architecture • Serve at Scale: Deploy and operate multiple models within shared GPU clusters on GKE • Drive Efficiency: Own GPU utilization as a first-class metric • Collaborate & Consult: Work directly with clients to understand performance requirements

Job Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
  • 5+ years of experience in ML/AI engineering, with a meaningful portion focused on performance, infrastructure, or systems
  • Proven track record of deploying and optimizing models in a production environment
  • Demonstrated experience profiling and improving GPU utilization for training and/or inference
  • Experience with Classic Machine Learning (neural nets, training, tuning) is a strong plus
  • Knowledge of Data Engineering and SQL

Benefits

  • Comprehensive Health Insurance
  • Paid Leave (Vacation/PTO)
  • Paid Holidays
  • Sick Leave
  • Parental Leave
  • Bereavement Leave
  • 401 (k) Employer Match
  • Employee Referral Bonuses

Related Job Pages

More Machine Learning Engineer Jobs

RecruityTalent logo

Senior MLOps Engineer

RecruityTalent

Connecting top IT and Executive talents with great companies in EMEA/LATAM through tailored recruitment solutions.

Full TimeRemoteTeam 1-10Since 2024H1B No Sponsor

• Design and build our central MLOps Platform covering the complete ML lifecycle • Architect robust CI/CD workflows and self-service capabilities • Partner with Data Scientists, ML Engineers, and Infrastructure teams • Establish and evangelize MLOps best practices across the organization • Optimize infrastructure costs and enhance observability

Bulgaria
iTalenters logo

Senior Machine Learning Engineer

iTalenters

Leading the art of connecting #tech talent with international IT projects

Full TimeRemoteTeam 11-50Since 2020H1B No Sponsor

• Desarrollar, mantener y optimizar modelos de Machine Learning aplicados a sistemas de recomendación y selección de creatividades publicitarias. • Trabajar sobre el recommendation engine para identificar qué anuncios funcionan mejor según cliente, campaña, audiencia y contexto. • Analizar datos de performance para detectar patrones, oportunidades de mejora y nuevas hipótesis de modelado. • Proponer, validar e implementar nuevos enfoques que mejoren la toma de decisiones dentro de la plataforma. • Participar en el ciclo de vida completo del modelo: análisis, feature engineering, entrenamiento, deploy, monitorización y mantenimiento. • Colaborar con el equipo creativo para entender sus necesidades y traducirlas en soluciones técnicas basadas en datos. • Trabajar junto al equipo de Machine Learning, MLOps y tecnología para llevar modelos a producción de forma robusta, escalable y mantenible.

Spain
ConnectWise logo

Principal Machine Learning Engineer

ConnectWise

A platform of software & services built for TSPs. Follow us for product updates, company news, business advice and more.

Full TimeRemoteTeam 501-1,000Since 1982H1B Sponsor

• The Principal Machine Learning Engineer is responsible for building Machine learning models based on diverse business requirements, setting up the pipelines, and assisting in delivering thoughtful experiences for our partners. This role works in partnership with cross-functional teams to contribute to the development of cutting-edge ML solutions. • Builds/ Optimizes machine learning models. • Researches, analyzes, and documents findings. • Assists in delivering production grade machine learning services that power the ConnectWise platform and products. • Designs and maintains machine learning infrastructure. • Informs, influences, supports, and executes on product decisions and product launches. • Works with cross-functional teams to ensure that proper data pipelines are established to ensure availability of high-quality data.

India
Fundamental logo

MLOps Lead

Fundamental

The Power to Predict. See the future in your data.

Full TimeRemoteTeam 51-200Since 2024H1B No Sponsor

• Lead and mentor a team of MLOps engineers, fostering technical growth and a culture of operational excellence • Define and drive the MLOps roadmap, aligning infrastructure capabilities with Research, Engineering and product objectives • Establish best practices, standards, and processes for ML infrastructure, deployment, and operations • Own technical decision-making for ML infrastructure architecture and tooling choices • Architect and oversee scalable, automated machine learning pipelines, CI/CD workflows, and orchestration frameworks • Drive the design and implementation of robust model serving infrastructure using platforms like Triton, TorchServe, TensorFlow Serving, and KServe • Define inference architecture strategy optimized for ultra-low latency and high throughput • Design and maintain feature stores, robust data pipelines, and scalable storage solutions to efficiently handle large volumes of data • Collaborate with research teams to bridge the gap between experimentation and production • Define logging, alerting, and monitoring strategy to track model performance, drift, and system reliability

Israel