AI Infrastructure Engineer

Location

United States

Posted

1 day ago

Salary

$100K - $150K / year

Seniority

Mid Level

Job Description

AI Infrastructure Engineer

Bright Vision Technologies

Role Description We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on: - GPU clusters - Distributed training frameworks - Scheduling - Storage performance - Developer experience for ML engineers and researchers The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work. Key Responsibilities - Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations. - Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams. - Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering. - Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate. - Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication. - Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics. - Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale. - Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing. - Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently. - Partner with research and applied ML teams to plan capacity for upcoming training runs. - Implement security controls, isolation, and access management for multi-tenant AI infrastructure. - Drive automation across cluster provisioning, lifecycle management, and configuration enforcement. - Maintain runbooks, capacity dashboards, and operational documentation for the AI platform. - Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling. Qualifications - Bachelor’s or Master’s degree in Computer Science or a related field. - Six or more years of experience in infrastructure, platform, or HPC engineering. - Hands-on experience operating GPU clusters or large-scale ML training infrastructure. - Strong proficiency in Python and at least one systems language such as Go or C++. - Deep understanding of distributed training, accelerator architectures, and collective communication. - Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads. - Strong understanding of Linux internals, networking, and high-performance storage. - Experience with at least one major cloud provider’s ML infrastructure offerings. - Strong software engineering practices including testing, CI/CD, and code review. - Excellent communication and cross-functional collaboration skills. Preferred Qualifications - Experience operating InfiniBand or RDMA networking at scale. - Contributions to open-source ML infrastructure projects. - Familiarity with custom orchestrators or research-grade training stacks. - Exposure to frontier model training operations. - Experience with FinOps for AI workloads. How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com .

Related Categories

Related Job Pages

More Infrastructure Engineer Jobs

Turner & Townsend logo

Procurement Specialist – Network Infrastructure

Turner & Townsend

A global consultancy business serving clients in the real estate, infrastructure and natural resources sectors.

Full TimeRemoteTeam 10,001+H1B No Sponsor

• Coordinating requests for quotes with manufacturers • Executing quotes in conjunction with stakeholders • OSP Shortage Mitigation: Managing risks and constraints in the OSP supply chain. • Logistics Oversight: Resolving critical, real-time onsite delivery queries. • Financial Controls: Conducting regular cost variance and budget checks. • Issue Resolution: Tracking kick-off bugs and driving PCG/TEC resolutions. • EMEA/APAC Deployment: Overseeing the ongoing regional OFCI implementation. • Vendor Alignment: Leading strategic syncs with key manufacturers. • SOX control responsibilities may be part of this role, which are to be adhered to where applicable.

New York
$145K - $165K / year
HomeVision logo

Infrastructure Engineer, AI & Data Security

HomeVision

Comprehensive collateral underwriting, powered by machine intelligence

ContractRemoteTeam 11-50Since 2020H1B No Sponsor

• Plan, design, and build - Secure infrastructure for AI-assisted development and testing - Data-access security across the platform - Cross-cutting application features You will manage your own projects, communicating designs, plans, and status updates proactively. We work in Go, Python, and TypeScript with a focus on reliability and observability.

Argentina
$5K - $8K / month
Vibrant Planet logo

Cloud Infrastructure Engineer

Vibrant Planet

Restoring natural systems through adaptive planning and market incentives

Full TimeRemoteTeam 11-50H1B No Sponsor

• Design, build, and maintain scalable, secure, and cost-efficient cloud infrastructure on AWS using Infrastructure as Code best practices. • Own and evolve our Atmos-based IaC framework, including stack configuration, component architecture, and environment lifecycle management. • Develop and maintain Terraform and OpenTofu modules and components, ensuring reusability, consistency, and DRY configuration across environments. • Lead and mature our CI/CD infrastructure pipelines using GitHub Actions, enabling reliable and automated infrastructure deployments. • Manage containerized workloads using Docker and Kubernetes (Helm), supporting our engineering and data science teams. • Build and maintain observability infrastructure using Prometheus and Grafana to ensure system reliability, performance visibility, and rapid incident response. • Collaborate closely with engineers, scientists, and other stakeholders to translate requirements into robust infrastructure solutions. • Lead and participate in development lifecycle activities including design, code review, testing, and production releases. • Mentor and support other engineers, deeply reviewing infrastructure code and elevating engineering standards across the team. • Contribute to our evolving engineering culture, standards, tooling, and processes. • Comply with Vibrant Planet’s Information Security Policy and the full security responsibilities detailed in the Employee Handbook, including complete required security training, safeguard customer and company data, keep credentials secure, and report suspected security incidents or policy violations through established channels. • Follow secure development practices, adhere to established change management processes for production systems, protect the confidentiality and integrity of customer data, and promptly address security vulnerabilities in your area of responsibility.

United States
$150K - $200K / year
Campbell's logo

Expert Engineer, Secure LAN Infrastructure

Campbell's

From soup to snacks, we've connected people through food they love since 1869.

Full TimeRemoteTeam 10,001+Since 1869H1B No Sponsor

• Serve as the technical lead for enterprise Secure LAN and Wi-Fi platforms, including design, configuration, optimization, and lifecycle management. • Define and maintain wireless standards for coverage, capacity, performance, resiliency, and security across all locations. • Lead technical execution for wireless deployments, upgrades, and redesigns across corporate offices, manufacturing plants, warehouses, and specialized environments. • Provide technical leadership for network authentication and access platforms supporting wired and wireless connectivity, including 802.1X, certificate-based authentication, device authentication, and identity-integrated access models. • Define and maintain enterprise network access control standards, including authentication methods, authorization models, device profiling, guest access, and policy enforcement patterns. • Lead the design and operational governance of identity-driven access control models supporting secure user, device, guest, and operational network access. • Define and enforce firewall security standards, segmentation models, and traffic control patterns aligned with cybersecurity policies and risk requirements. • Partner with Cybersecurity and Identity teams to ensure authentication, segmentation, and enforcement services align with Zero Trust principles and enterprise security standards. • Support secure access models across enterprise, manufacturing, warehouse, and site-based network environments. • Provide technical leadership for resilient LAN and WAN designs supporting high availability, operational continuity, and scalable connectivity. • Govern MSP-delivered operations, monitoring, and incident response for in-scope services and technologies. • Act as the senior escalation point for complex or systemic access, connectivity, routing, switching, wireless, authentication, and security incidents. • Lead root-cause analysis and corrective action planning for major outages and recurring network incidents. • Participate in design reviews and infrastructure solutioning efforts across network, cybersecurity, cloud, and infrastructure initiatives. • Define and maintain engineering standards, configuration baselines, network design patterns, documentation, and runbooks. • Identify opportunities to improve reliability, resiliency, security posture, operational discipline, automation, and cost efficiency.

United States
$153.9K - $211.6K / year