• Demonstrate leadership and ownership of the platform to deliver services for projects and users. • Provide infrastructure guidance of data platform capabilities to accommodate business/technical use cases. • Leverage your strong communication skills to keep users informed and provide excellent quality of service. • Automate and manage provisioning needs, such as Snowflake storage and compute, Role Based Access Control model, and permissions. • Configure and manage monitoring/alerting around replication latency, performance (cluster & query), and Airflow. • Coordinate and collaborate with dependent infrastructure and AWS services to implement Snowflake integration with services, such as S3, IAM, SSO, etc. • Provide technical expertise, troubleshooting, and support for change management, governance compliance, internal audits, and remediations.

• Contribute to building and improving platform services, writing code, reviewing changes, and supporting deployments. • Work alongside senior engineers to design and implement solutions that improve scalability, reliability, and developer experience. • Help maintain and operate core systems such as CI/CD pipelines, cloud infrastructure, and monitoring. • Participate in incident response and retrospectives, contributing to learning and improvement. • Collaborate with other engineers to understand needs and translate them into practical platform solutions. • Take ownership of tasks and smaller projects, while developing towards owning larger areas of the platform.

• Own infra topology, scaling and blast-radius boundaries. • Build the validation gates, idempotency checks, drift detectors, and runbooks. • Diagnose novel failures such as consumer lag, DLQs, materialized-view chains. • Own the 500K events/sec target: load testing, tuning, Database sizing, SLOs and alerting. • Own IAM/IRSA, secret rotation, and the auth chain. • Keep skills, runbooks, and agent context in sync with reality. • Lead incidents and capture every fix as a new runbook plus regression test.

Role Description We are seeking an AI Platform Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production. The role focuses on the systems engineering side of AI deployment, including: - Request routing - Batching - Caching - Autoscaling - GPU utilization - End-to-end observability across diverse model workloads The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving. Qualifications - Bachelor’s or Master’s degree in Computer Science or a related field. - Six or more years of experience in distributed systems, infrastructure, or ML platform engineering. - Strong proficiency in Python and a systems language such as Go, Rust, or C++. - Deep experience operating high-throughput, low-latency services in production. - Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM. - Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization. - Familiarity with Kubernetes, autoscaling, and modern cloud platforms. - Experience with observability stacks including metrics, tracing, and structured logging. - Solid grounding in performance engineering and capacity planning. - Strong communication and incident response skills. Requirements - Design and operate model serving platforms supporting diverse workloads including LLMs, vision models, and recommendation systems. - Optimize inference performance using continuous batching, paged attention, speculative decoding, and request multiplexing. - Implement multi-tenant routing, rate limiting, and quality-of-service policies across model endpoints. - Build autoscaling and capacity management systems that balance latency, throughput, and cost. - Tune GPU utilization, memory management, and KV cache strategies for LLM serving workloads. - Integrate model serving with API gateways, identity systems, and observability platforms. - Implement caching, prompt deduplication, and response reuse strategies where appropriate. - Drive end-to-end observability including latency histograms, queue dynamics, GPU utilization, and error tracking. - Develop deployment workflows including canary releases, shadow testing, and automated rollback. - Operate incident response for high-availability AI services and drive durable reliability improvements. - Collaborate with ML and product teams to support new model releases and capability rollouts. - Implement security controls including request signing, content filtering, and abuse detection at the serving layer. - Document operational procedures, performance characteristics, and tuning guidance for internal teams. - Stay current with AI serving research and translate advances into production capabilities. Preferred Qualifications - Open-source contributions to model serving infrastructure. - Experience with multi-region or globally distributed AI serving. - Familiarity with model quantization, distillation, and compression techniques. - Exposure to FinOps for AI workloads and cost-efficient serving design. - Experience supporting external-facing AI APIs at scale. How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com . Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.