Deepgram logo
Deepgram

Building foundational AI for speech transcription and understanding.

Systems Architect – AI/ML Infrastructure

Systems EngineerSystems EngineerFull TimeRemoteLeadTeam 51-200Since 2015H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

68 days ago

Salary

$160K - $220K / year

Seniority

Lead

Bachelor Degree7 yrs expEnglishAWSCloudKubernetes

Job Description

Systems Architect – AI/ML Infrastructure

Deepgram

• Define and drive the end-to-end infrastructure architecture for Deepgram's AI/ML workloads across production inference and research training • Design multi-cloud and hybrid infrastructure strategies that balance performance, reliability, cost, and vendor flexibility • Architect compute orchestration systems that efficiently schedule and manage GPU and CPU workloads across heterogeneous infrastructure • Design storage architectures that handle the massive datasets required for speech and audio ML -- from high-throughput training data pipelines to low-latency model serving • Lead capacity planning across all infrastructure dimensions, modeling growth and ensuring Deepgram can scale ahead of demand • Drive cost optimization and FinOps practices, identifying opportunities to reduce infrastructure spend without compromising performance or reliability • Design burstable, elastic training infrastructure that can scale up for large training runs and scale down to minimize idle cost • Architect research compute infrastructure that gives ML teams the resources they need while maintaining operational efficiency • Establish architectural standards, design review processes, and technical documentation practices for infrastructure decisions • Collaborate with engineering leadership to align infrastructure strategy with product roadmap and business objectives • Evaluate emerging hardware, cloud services, and infrastructure technologies for potential adoption

Job Requirements

  • 7+ years of experience in infrastructure engineering, systems architecture, or a senior technical role focused on large-scale infrastructure
  • Proven experience designing multi-cloud architectures spanning AWS and at least one other major cloud provider or on-premises environment
  • Deep expertise in storage system design -- block, object, and file storage, including performance tuning for large-scale data workloads
  • Strong experience with compute orchestration using Kubernetes, and an understanding of how to schedule diverse workloads efficiently
  • Hands-on experience with GPU infrastructure -- procurement considerations, cluster design, driver and runtime management
  • Track record of capacity planning and infrastructure scaling for high-growth environments
  • Ability to communicate complex architectural decisions clearly to both technical and non-technical stakeholders
  • Strong understanding of networking fundamentals as they relate to infrastructure architecture

Benefits

  • Medical, dental, vision benefits
  • Annual wellness stipend
  • Mental health support
  • Life, STD, LTD Income Insurance Plans
  • Unlimited PTO
  • Generous paid parental leave
  • Flexible schedule
  • 12 Paid US company holidays
  • Quarterly personal productivity stipend
  • One-time stipend for home office upgrades
  • 401(k) plan with company match
  • Tax Savings Programs

Related Categories

Related Job Pages

More Systems Engineer Jobs

Prime System Solutions logo

Endpoint Systems Engineer, L2

Prime System Solutions

"Empowering Excellence, Ensuring Continuity, Uninterrupted Success"

Systems Engineer68 days ago
Full TimeRemoteTeam 51-200Since 2023H1B No Sponsor

• Perform **patching and updates for client systems** using **Kaseya VSA**. • Manage and deploy operating system and application patches through **Microsoft Intune**. • Support patching activities using **Datto RMM**, including monitoring, troubleshooting failures, and ensuring successful deployment. • Generate and maintain **patch compliance reports**, ensuring systems meet security and compliance standards. • Deploy, update, and manage **third‑party applications** across endpoint devices. • Use **PowerShell scripting** to automate endpoint tasks, improve efficiency, and resolve recurring issues. • Maintain endpoint performance, stability, and security across multiple environments. • Handle and resolve incidents, service requests, and patch‑related issues via the **ConnectWise ticketing system**. • Work independently on L2‑level tasks while escalating complex issues when appropriate. • Follow defined SLAs and operational processes in a high‑volume, ticket‑driven environment. • Maintain accurate endpoint documentation and asset visibility using **Liongard**. • Assist with **remediating an existing backlog of Liongard deployments**, including: - Reviewing and fixing failed or incomplete inspections - Re‑establishing connections and configurations - Cleaning up and validating asset data - Ensure endpoint configurations and asset records are current and reliable.

South Africa
Leidos logo

Systems Engineer

Leidos

Leidos is an innovation company rapidly addressing the world’s most vexing challenges in national security and health.

Systems Engineer68 days ago
Full TimeRemoteTeam 10,001+Since 1969H1B Sponsor

• Working with operational stakeholders, technology suppliers and architects to refine system and sub-system requirements and acceptance criteria • Allocation of requirements to lower-level components, conducting technical derivation analysis as required • Modelling of functional and non-functional requirements and scenarios using MBSE and architectural framework approaches • Modelling operational, business and system designs & behaviours within architectural views • Managing compliance assessments at system and lower levels • Maintaining the high-level design and overseeing development of lower-level designs • Producing detailed engineering artefacts such as: High and Low Level Designs, Interface Control Documents (ICDs) / Application Programming Interfaces (APIs), Compliance Reports • Preparing for and delivering milestone technical reviews and the associated work product deliverables • Managing the technical backlog and the content of associated releases

United Kingdom
£47.6K - £61K / year
Job Closed
Planit logo

Cloud Systems Engineer, Azure Cosmos DB

Planit

Planit is a leader in Quality Assurance and Engineering, providing best-in-class consultancy, training, and services.

Systems Engineer68 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Design & optimize data models for Cosmos DB & SQL • Manage data performance, indexing, partitioning & throughput • Operate & improve ETL/ELT pipelines (Cosmos & SQL) • Implement data quality checks, monitoring & validation • Manage backup, recovery, scaling & retention policies • Secure data access using RBAC, managed identities & Key Vault • Support application teams with query tuning & data modelling • Ensure reliability & health of data platforms

Philippines
Job Closed

Senior Control Systems Engineer

Rolls-Royce

Rolls-Royce provides power systems for various industries, such as aerospace, marine, and energy sectors. The company promotes an environment of innovation, inc

Systems Engineer68 days ago

Title: Senior Control Systems Engineer Location: Indianapolis United States Job Description: time type Full time job requisition id JR6126643 Job Description Job Title: Senior Controls System Engineer Working Pattern: Full-time Working location: Indianapolis, IN Rolls-Royce is looking for a Senior Control System Engineer to join our growing team. This is an exciting opportunity to work on flagship Rolls-Royce programs and play a vital role in solving some of the most complex and interesting technological challenges in the industry while being part of a global, multi-disciplinary team. As a Senior Control System Engineer, you will be the owner of assigned control system functions and interfaces. You will be responsible for providing technical guidance, counsel, and direction to a small team of engineers to ensure technical outcomes are delivered to appropriate standards and quality while working with a global engineering community to identify areas for collaboration and knowledge exchange. You will support full life cycle development and mentor junior engineers on processes, tools, and technical solutions. In this role, you will have the opportunity to travel up to 20% between Rolls-Royce sites and up to 10% other travel. Why Rolls-Royce? Rolls-Royce is one of the most enduring and iconic brands in the world and has been at the forefront of innovation for over a century. We design, build and service systems that provide critical power to customers where safety and reliability are paramount. We are proud to be a force for progress, powering, protecting and connecting people everywhere. We want to ensure that the excellence and ingenuity that has shaped our history continues into our future and we need people like you to come and join us on this journey. Rolls-Royce has been recognized as the top employer in the Engineering & Manufacturing category on the prestigious Forbes Top Employers for Engineers list for 2025. This ranking highlights our commitment to innovation, employee development, and fostering a collaborative environment where engineers can thrive. Be part of a team that sets the industry standard and drives groundbreaking solutions. At Rolls-Royce, we are committed to creating a workplace where all employees feel respected, supported, and empowered to do their best work. We foster a welcoming and innovative work environment that invests in you, giving you access to an incredible breadth and depth of opportunities where you can grow your career and make a difference. Rolls-Royce is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to any protected characteristics. What you will be doing With this attractive opportunity you will get a chance to: - Collaborate with other teams and customers to develop electrical, electronics and mechatronics control system requirements, design and verification work products for safety critical applications as per ARP4754A and appropriate guidance within DO-178C - Work with a cross-functional team to establish the highest standards of technical capability, quality, professionalism, and teamwork - Provide and support engineering and process guidance, training and, create documentation - Review engineering work products for technical documentation, quality, completeness - Resolve complex problems through the application of acquired technical experience and knowledge - Develop and communicate complex technical ideas and information in a concise and logical way Who we’re looking for: At Rolls-Royce we put safety first, do the right thing, keep it simple and make a difference. These principles form the behaviours that guide us and are an essential component of our assessment process. They are the fundamental qualities that we seek for all roles. Basic Requirements: - Bachelor’s degree in Aerospace, Mechanical, Electrical or Computer Engineering with 2+ years of product development engineering experience, OR - Master’s degree in in Aerospace, Mechanical, Electrical or Computer Engineering, OR - PhD in degree in in Aerospace, Electrical, Mechanical or Computer Engineering - Experience with requirements management - In order to be eligible for consideration, you must be a U.S. Citizen Preferred Requirements: - 5+ years of product development engineering experience - Application of agile development methods to deliver engineering work products - Experience with military qualification of airborne systems - Experience with FAA certification - Gas turbine engine, propulsion, or electrical control system experience - Demonstrated experience with control system design and analysis tools - Development of model-based systems with digital engineering toolsets (MATLAB, Simulink and/or similar) - Knowledge of systems engineering, and robust design tools and techniques coupled with the latest model-centric development approaches - Experience with Cameo Systems Modeler (MagicDraw) or similar SysML modelling software What we offer We offer excellent development opportunities, a competitive salary, and exceptional benefits. These include bonus, employee support assistance and employee discounts. Your needs are as unique as you are. Hybrid working is a way in which our people can balance their time between the office, home, or another remote location. It’s a locally managed and flexed informal discretionary arrangement. As a minimum we’re all expected to attend the workplace for collaboration and other specific reasons, on average three days per week. For fully remote roles, employees can live in any state except Idaho, Nebraska, Nevada, Vermont, and Wyoming. Relocation assistance is available for this position. Closing date: April 15th, 2026 #CLODEF Job Category Software Systems Job Posting Date 30 Mar 2026; 00:03 Pay Range $90,985 - $ 147,850-Annually Location: Indianapolis, IN Benefits Rolls-Royce provides a comprehensive and competitive Total Rewards package that includes base pay and a discretionary bonus plan. Eligible employees may have the opportunity to enroll in other benefits, including health, dental, vision, disability, life and accidental death & dismemberment insurance; a flexible spending account; a health savings account; a 401(k) retirement savings plan with a company match; Employee Assistance Program; Paid Time Off; certain paid holidays; paid parental and family care leave; tuition reimbursement; and a long-term incentive plan. The options available to an employee may vary depending on eligibility factors such as date of hire, employment type, and the applicability of collective bargaining agreements.

Indiana
$91.0K - $147.9K / year
Job Closed