Fundamental logo
Fundamental

The Power to Predict. See the future in your data.

Model Serving Engineer

EngineerEngineerFull TimeRemoteSeniorTeam 51-200Since 2024H1B No SponsorCompany SiteLinkedIn

Location

Israel

Posted

62 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishPythonTensorflow

Job Description

Model Serving Engineer

Fundamental

• Design, build, and maintain production model serving infrastructure using Triton Inference Server as the primary framework • Implement and optimize inference pipelines including custom backends, dynamic batching strategies, and model ensemble configurations in Triton • Optimize Python inference code for performance, with a strong focus on GIL contention, multi-threading, and concurrency patterns • Tune throughput and latency across the full serving stack, batching policies, thread pool sizing, model instance groups, and memory layout • Work closely with the research team to understand new model architectures at a computational level, batching behavior, dynamic shapes, memory access patterns etc • Own the full resource observability and control loop for production inference - instrument GPU memory, CPU, batch queue depth, and latency metrics, and actively tune model instance groups, concurrency limits, memory budgets, and batching configuration in response to observed behavior • Evaluate and integrate alternative inference frameworks and runtimes as the model ecosystem evolves • Contribute to GPU utilization improvements and resource efficiency across the serving fleet

Job Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
  • 5+ years of experience in model serving, ML infrastructure, or a closely related backend engineering role
  • Deep, production-level experience with Triton Inference Server, including custom Python backends, batching configuration, and model repository management
  • Expert-level Python skills with a thorough understanding of the GIL, multi-threading, multiprocessing, and async concurrency patterns
  • Strong understanding of neural network inference mechanics, forward passes, batching strategies, memory management, and numerical precision tradeoffs
  • Hands-on experience with other inference frameworks (TorchServe, TensorFlow Serving, ONNX Runtime, vLLM, etc.) and the ability to evaluate tradeoffs between them
  • Experience profiling and optimizing inference code for latency and throughput at production scale

Benefits

  • Competitive compensation with salary and equity
  • Comprehensive health coverage, including medical, dental, vision, and 401K
  • Paid parental leave for all new parents, inclusive of adoptive and surrogate journeys
  • Relocation support for employees moving to join the team in one of our office locations
  • A mission-driven, low-ego culture that values diversity of thought, ownership, and bias toward action

Related Categories

Related Job Pages

More Engineer Jobs

Fragomen logo

Support Engineer

Fragomen

Fragomen is a law firm specializing in immigration law. The global company was founded in 1951 and is based in New York, New York. The firm has over 40 offices

Engineer62 days ago
Full TimeRemoteTeam 5,001-10,000

Job Description Support Engineer Contract: Full-time, permanent Team: Global Development Lab Office Location: UK Remote The role: Our Software Engineers design and implement web applications using popular technologies including C# .NET Core and Typescript. As a core member of the team you will play an integral part in the design, implementation, and delivery of new features and applications. You will make key contributions and be involved in decision making regarding the technical direction of our products. You’ll participate in the problem definition and solution process with a diverse group of Engineers, designers and business owners from around the company. What your day will look like: - Support and maintain .NET web apps and APIs - Support UI/UX using Angular or React - Evaluate defect reports and analysis their effect system - Review system errors to identify and rectify potential defects - Collaborate with various teams within the business and in IT, to ensure the development is consistent with requirements. The team: The Fragomen Global Development Lab (GDL) is an innovation group within Fragomen focused on developing and supporting technology solutions targeting business travel, mobility, and cross border employment compliance. What we are looking for: *This role is considered an entry level role and would suit those seeking to kickstart their career in software engineering* Essential criteria: - Experience with SQL and NoSQL databases - Experience with #C or similar languages - Experience with Angular or similar frameworks - Experience in ASP.NET - Experience in Git Repository branch management - Knowledge in working with various design patterns e.g. MVVM - Excellent communication skills - both verbal and written are MUST - Sound knowledge of the SDLC and CI/CD process - Strong data analysis and troubleshooting skills - Demonstrated critical thinking skills, using logic and reasoning to identify the strengths and weakness of alternative solutions, conclusions or approaches to problems. - Proven experience in handling multiple deliverables efficiently *Some overtime will be required, and the candidate must be available to work off-hours on evenings and weekends as needed. What we offer: A career at Fragomen will provide you with the opportunity to work in an exciting environment for a broad range of clients, where no two days will be the same. You will face interesting challenges, and will work with dedicated, friendly and ambitious people, where providing exceptional client service is at the core of what we do. We are extremely proud of our workforce at Fragomen, and we are fully committed to providing equal opportunities. At Fragomen, we value our employees and are committed to providing a comprehensive benefits package that supports your well-being and professional growth. Our UK offerings include: - Competitive Salary: We offer salaries that reflect your skills and experience - Health and Wellness: A comprehensive employee assistance programme, gym discounts, medical insurance, Headspace membership and wellbeing platforms - Lifestyle and Savings: Discount platforms, cycle to work scheme, electric car lease scheme, season ticket loans and family support resources - Protection and Security: Life assurance, group income protection and a workplace pension scheme including a 5% employer contribution - Time Away from Work: 25 days annual leave, + bank holidays and 3 personal leave days. Enhanced family leave policies, volunteering days and birthday leave - Professional Development: Access to our e-learning platform, mentoring schemes and training bursaries (where applicable) What to expect: - Once you have submitted your application, our Talent Acquisition team will review your skills and experience. If these match the requirements of the position, a member of our team will contact you to schedule an initial phone call. - If shortlisted, you will be invited to participate in our interview process, which will consist of at least two stages, one of which will be conducted in-person. Depending on the role, you may also be required to complete a written assessment. - After the interviews, we will carefully evaluate all candidates and make our final decision. You will be notified of the outcome and feedback will be provided. - At Fragomen, we are committed to fostering an inclusive and accessible workplace for all applicants and employees. If you require any specific accommodations or support during the interview process, please let us know, and we will consider what reasonable adjustments are possible to meet your needs Who we are: At Fragomen, we are more than a global immigration services provider – we are pioneers shaping the future of mobility. With a passion for navigating the complexities of immigration, we help individuals and businesses transcend borders, unlocking opportunities around the world. As a forward-thinking, global business, we combine deep expertise with innovative technology to craft solutions that not only simplify the immigration process but also drive strategic success for our clients. Whether it is assisting multinational companies or helping people start new chapters in their lives, we are driven by the belief that global movement is the key to unlocking a world of possibilities. We are proud of our team spirit, and we like to reflect this in the way that we work and everything we do. Our Responsible Business Practices ("RBP") prioritize Fragomen's social responsibility through a cohesive strategy covering five key focus areas: Corporate Social Responsibility, Culture and Inclusion, Sustainability, Well-Being and Pro Bono. Our RBP initiatives offer great opportunities for everyone at Fragomen to feel included, get involved and shape thoughtful initiatives and activities. For more information, please visit our website – https://www.fragomen.com/about/responsible-business-practices.html. Fragomen is committed to promoting equal opportunities for all employees and applicants, regardless of race, ethnicity, heritage, gender, age, religion, disability, sexual orientation, gender identity or intersex status. All offers and/or employment contracts are contingent upon the successful completion of the Firm’s pre-employment screening process. This process may include verifying the candidate’s identity, confirming legal authorization to work in the offered position's location, and conducting a comprehensive background check, where permitted by local regulations.

United Kingdom
HARMAN International logo

Associate Engineer, SW

HARMAN International

Harman International is a global leader in automotive technology, lifestyle innovations, design and analytics.

Engineer62 days ago
Full TimeRemoteTeam 10,001+H1B Sponsor

HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the opportunities, innovative technologies and resources to build a successful career. A Career at HARMAN As a technology leader that is rapidly on the move, HARMAN is filled with people who are focused on making life better. Innovation, inclusivity and teamwork are a part of our DNA. When you add that to the challenges we take on and solve together, you’ll discover that at HARMAN you can grow, make a difference and be proud of the work you do everyday. Introduction: A Career at HARMAN Automotive We’re a global, multi-disciplinary team that’s putting the innovative power of technology to work and transforming tomorrow. At HARMAN Automotive, we give you the keys to fast-track your career. - Engineer audio systems and integrated technology platforms that augment the driving experience. - Combine ingenuity, in-depth research, and a spirit of collaboration with design and engineering excellence. - Advance in-vehicle infotainment, safety, efficiency, and enjoyment. About the Role: The Telematics Solution position will report into the HARMAN Engineering organization and will be responsible for researching and the delivering software’s, POCs for automotive embedded devices, which are both consumer and automotive grade products. Telematics is the key foundational technology for the connected car and autonomous driving. It includes technology like LTE modems and network access devices (NADs) as well as wireless standards e.g. BT/WiFi, GNSS, NFC etc. are one of the fastest growing areas. HARMAN works with leading suppliers to design telematics solutions to ensure every in-car experience is entertaining, productive, safe, and secure. As part of an agile team, you will research and build the software on telematics devices with state-of-the-art technologies and features like communication, networking, and positioning. You will be on a path finding mission to enable and create new business in the Telematics domain. Will be part of highly visible demos, and lead the effort to bring the product and solutions to market. Your responsibilities include design verification, testing, debugging, and RCA of defects. What You Will Do ​ - Play the individual contributor role in software/firmware design and development for V2X and MEC domain for embedded platform products. - Take complete technical ownership of ensuring that there are no gaps in designing scalable and reusable software components; have hands-on experience in solving all critical technical issues. - Design and develop scalable, maintainable, well automotive-grade Linux applications for V2X devices in compliance with industry standards on embedded platforms. - Understand business requirements, associate them with agile entities (epics/stories/tasks) for planning and execution. - Although primarily a technical role, you should have the right interpersonal skills to be approachable, define, drive, and negotiate, and reach timely consensus on issues within the team as well as with customers. - Be able to independently drive requirements discussions with customers, - Initiate and track dependencies of technical deliveries with external and internal stakeholders. - Interface with System and Software architects and drive discussions. - Responsible for the technical delivery and management of key features. - Contribute new ideas and be proactive in working with multiple teams to resolve technical issues What You Need to Be Successful - Master's/bachelor’s degree in electrical, communications, computer engineering,g or a similar discipline - Should have 3 to 5 years of overall experience in software development in embedded development practices using C++ and C; solid foundation in OOPS concepts and prior experience in architecture and design of software, and working with teams across geographical locations - Should have strong programming skills in C++ - Working experience in Linux Embedded Systems - Working experience in Linux Systems Programming. Good understanding of - Linux Inter Process Communication mechanisms (sockets, message queues, shared memory) - Concepts and techniques for Multithreaded applications - State Machine Implementation - Prior experience in working directly with customers during requirement analysis, scoping, discussing key issues, and seeking resolutions to technical topics. - Excellent written and oral communication skills to collaborate with teams across geographies. - A broad technical background with general knowledge of cellular and network technology (5G, V2X), standards, software architectures, and automotive-grade products and processes - Must have previous experience in high-level and low-level design of modules - Must have previous experience in Requirement analysis and usage of requirements analysis tools like DOORS - Apt knowledge of software architecture tools such as Enterprise Architect. - Ability to work independently and mentor team members - Preferred experience developing and debugging software in a real-time, embedded, multiprocessor, multi-interface environment using standard tools such as GDB, Valgrind, Wireshark, etc. - Working experience with industry standard version control systems like GIT, Gerrit - Working experience witha unit test automation tool Bonus Points if You Have - Prior hands-on experience with embedded software testing for Automotive Products is a strong plus. - Experience in V2X Technologies / Vehicle Security / Telematics / Data Communication/ Vector CANoe. - A broad technical background with general knowledge of cellular and network technology (5G, V2X), standards, software architectures, and automotive-grade products and processes. - Hands-on automotive special tools such as Vector Can Analyzer, Canoe. What Makes You Eligible - Be willing to travel up to 10%, domestic and international travel. - Proven record of experience in technical leadership of a software Design team. - Effectively supervising, leading, and delegating tasks - Experience in test methodologies, tools, and methods - Good knowledge of embedded systems - Strong Know-How of technical/automotive standards in infotainment or telematics software projects - Efficiently meeting deadlines, schedules, and target dates What We Offer - Flexible work environment, allowing for full-time remote work globally for positions that can be performed outside a HARMAN or customer location - Access to employee discounts on world-class Harman and Samsung products (JBL, HARMAN Kardon, AKG, etc.) - Extensive training opportunities through our own HARMAN University - Competitive wellness benefits - Tuition reimbursement - “Be Brilliant” employee recognition and rewards program - An inclusive and diverse work environment that fosters and encourages professional and personal development #LI-JD1 HARMAN is proud to be an Equal Opportunity / Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

India
Job Closed
Bosch Group logo

Mid-level Product Safety Engineer (33270)

Bosch Group

Our ELPRO Division has supported the pharma, biotech, and healthcare industries with intelligent monitoring solutions—ensuring compliance, visibility, and safety from production to patient. ELPRO has been a trusted partner in compliant environmental monitoring. Committed to supporting the entire pharmaceutical supply chain—from production and storage to transport and delivery to the end user. In-house developed hardware and software, GxP-compliant consulting, and global support services. Ensures data integrity, compliance, and peace of mind—every step of the way.

Engineer62 days ago
Full TimeRemoteTeam 10,001

Company Description At Bosch, we shape the future through high-quality technological innovations and services that inspire enthusiasm and improve people’s lives. We make a solid promise to our associates: we grow together, we enjoy our work, and we inspire one another. Join us and experience the difference. Job Description • Analyze the safety and risk of a product based on severity and probability. (some Hazards: shock, burn, laceration, or other mechanical harm). • Identify mitigation for hazards according to the following hierarchy: (ref: the priorities: 1. Design-out hazard, 2. Guard against the hazard, 3. Warn for hazard, 4. Instruct ) • Strong English language communicator. • Confident Independent thinker. • Performs and documents Product Safety Review. • Physical review of products and documentation at build milestones. • Establish performance requirements based on: analysis and investigations of product use, field data, and benchmarking competitors,. • Read, understand and critically review test reports, as part of the safety review. [JM2] • Occasional support to other US based safety engineer to collect missing data, push for responses from global product teams. • Meet with teams based in Asia, Europe, or USA, to understand product attributes prior to prototype. Qualifications - Bachelor's degree in Engineering Electrical, Mechatronics, Mechanical or Product Quality - English and Brazilian Portuguese languages skills (fluent) - Experienced and collaborative professional with strong experience in product safety and risk management. - Proven ability to conduct safety assessments, lead liability investigations, review technical documentation, and ensure compliance with internal and external standards. - Able to manage safety standards and processes, promote continuous improvement, and supervise teams to achieve departmental objectives. - Prior experience in product in Product Quality (QMM2) or: safety, risk analysis, agency approval, or regulatory compliance. - Printed Circuit Board test report analysis. - Familiarity with Class B software - Experience with SCF (safety critical function) analysis and testing. - Fault Tree Analysis, DFMEA experience, or problem solving. - Solid knowledge of technical standards, legislation, and safety best practices. - Additional Requirement: Active CREA registration (Brazilian Engineering Council license) is mandatory for hiring. #LI-TV1 Additional Information Benefícios da Bosch - Programas de Bem-Estar e Saúde: avaliação preventiva anual, ambulatório dentro da localidade para atendimento durante o horário de trabalho, programa antitabagismo, programa de saúde mental, fisioterapia e curso de gestante - Assistência médica e odontológica - Política de reembolso para algumas condições especiais de saúde - Subsídio para medicamentos através da Funcional Health - Jornadas de trabalho flexível com política de home office (não aplicado para horistas) - Short Friday para administrativo e horista do turno normal (apenas em Campinas) - Participação nos lucros e resultados (PLR) - Política de expatriação internacional e de transferências nacionais - Plano de previdência privada e empréstimos com taxas diferenciadas - Seguro de vida - Associação opcional ao Clube da Bosch dentro da planta com academia, piscinas, churrasqueiras, campos de futebol e society, espaço para eventos, ginásio de esportes, quadras de areia, quadra de tênis, lanchonete e calendário anual de eventos - Auxílio para mamães com creche na planta (verificar vagas disponíveis) - Licença maternidade e adoção estendida de 180 dias - Licença paternidade e adoção de 20 dias - Alimentação no local de trabalho e Vale Alimentação - Ônibus fretado (ou Vale Transporte) - Estacionamento gratuito (para quem vem presencial) - Benefícios de fim de ano com Cesta de Natal e ave congelada - Brinquedo para filhos menores de 12 anos - Material escolar para colaboradores (até nível universitário) e filhos (até final do ensino médio) - Política de subsídios para cursos técnicos, pós-graduação, MBA, especializações e idiomas - Treinamentos e capacitações através da nossa universidade corporativa - Premiação por tempo de casa (a partir de 10 anos e a cada 5 anos) - Participação opcional em várias ações de voluntariado via Instituto Robert Bosch - Descontos com parceiros do clube: locação de veículos, mensalidade em universidades, cursos de idioma, lojas e outros Leia nossos artigos no Medium e saiba como é trabalhar na área de Tecnologia da Bosch Brasil: Bosch Tech Brasil – Medium https://medium.com/@boschtechbr Informações adicionais - Vaga elegível para pessoas com deficiência ou reabilitadas - Não contratamos menores de 16 anos e somos contra o trabalho infantil - Modelo de trabalho: Remoto - Se esta vaga for elegível ao modelo Home Office, a avaliação do posto de trabalho será uma das etapas do processo seletivo - Área contratante: SO/OPM-TS11-BR Para colaboradores Bosch - Prazo: 28/01/2026 - Sua candidatura pode ser feita internamente pelo site SmartHub - Após se candidatar, recomendamos informar a sua liderança - Verifique a elegibilidade desta vaga em nosso Programa de Indicações “Indica Ai” (conforme RCD 12030-000) Na Bosch, acreditamos que a diversidade é o motor da inovação, por isso, todas as vagas são elegíveis para pessoas com deficiência, em situação vulnerável e grupos minoritários. Junte-se a nós e sinta a diferença. Work#LikeABosch. bosch.com.br/carreiras - Legal Entity: Robert Bosch Ltda.

Brazil
Job Closed
Full TimeRemoteTeam 1,001-5,000

Company Description Accesa is a leading technology company headquartered in Cluj-Napoca, with offices in Oradea and 20 years of experience in turning business challenges into opportunities and growth. A value-driven organisation, it has established itself as a partner of choice for major brands in Retail, Manufacturing, Finance, and Banking. It covers the complete digital evolution journey of its customers, from ideation and requirements setup to software development and managed services solutions. With more than 1,200 IT professionals, Accesa also has a fast-growing footprint, establishing itself as an employer of choice for IT professionals who are passionate about problem-solving through technology. Coming together in strong tech teams with a customer-centric approach, they enable businesses to grow, delivering value for our clients, partners, industry, and community. Job Description Our client is a trusted partner in the financial-banking sector in Germany, both in the public and private sectors who offers services for over 150,000 banking workstations and for more than 4,500 employees. It covers over 60% of banking sector in Germany. Responsibilities - M365 Knowledge: As a Senior Workplace Engineer, your primary focus will be ensuring optimal performance and uptime for key M365 services, particularly Teams, SharePoint, OneDrive, O365, and Exchange/Outlook Client. You will regularly monitor these services to maintain and enhance their reliability and efficiency. - Issue Resolution and Troubleshooting: Provide advanced support for M365-related issues by diagnosing and resolving technical problems promptly to minimize disruption and ensure a seamless user experience. - System Upgrades and Enhancements: Conduct essential upgrades, patches, and enhancements across the M365 environment to maintain system integrity and performance. Ensure all services are up to date and aligned with business requirements. - Security and Compliance: Implement and uphold security protocols to protect M365 services from unauthorized access, ensuring compliance with industry standards and organizational policies. - Collaborative Operations: Work closely with cross-functional teams to ensure the smooth operation of M365 services. Provide technical expertise for ongoing projects and support cross-departmental collaboration. - Ticket Management: Manage and resolve support tickets through the ticketing system, prioritizing tasks to meet service level agreements (SLAs) and ensuring timely resolution of all issues. Qualifications Must have: - Proven experience as a Technical Support Engineer or similar role, with a minimum of 3 years of experience supporting M365 services - Hands-on experience with configuration and administration within the M365 environment - Strong understanding of security best practices for M365 services - Experience with system monitoring, performance tuning, and troubleshooting within M365 - Ability to manage multiple priorities and meet deadlines in a fast-paced environment - Proficiency in German (B2/C1) and English, both written and spoken ​​​​​​​Nice to have: - Certifications related to M365 services (e.g. Microsoft Certified: Teams Administrator Associate, SharePoint Administrator, etc.) - Experience with PowerShell scripting and automation for managing M365 services Additional Information At Accesa you can: Enjoy our holistic benefits program that covers the four pillars that we believe come together to support our wellbeing, covering social, physical, emotional wellbeing, as well as work-life fusion. - Physical Wellbeing: Our wellbeing program includes medical benefits, gym support, and personalised fitness options for an active lifestyle, complemented by team events and the Healthy Habits Club. - Work-Life Fusion: In very dynamic industries such as IT, the line between our professional and personal lives can quickly become blurred. Having a one-size-fits-one approach gives us the flexibility to define the work-life dynamic that works for us. - Emotional Wellbeing: We believe that to maintain our overall health, we need to invest in our mental wellbeing just as much as we do in our physical health, social connections or in achieving work-life balance. - Social Wellbeing: As a growing community in a hybrid environment, we want to ensure we remain connected not just by the great work we do every day but through our passions and interests. - Department: Platforms | Systems Engineering 2

Oman + 1 moreAll locations: Oman | Romania