Staff AI Engineer – AI Infrastructure, Agentic Platform

Infrastructure EngineerInfrastructure EngineerFull TimeRemoteLeadTeam 201-500Since 2017H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

2 days ago

Salary

0

Seniority

Lead

Bachelor Degree7 yrs expEnglishAWSAzureCloudPythonTerraformTypeScriptGo

Job Description

Staff AI Engineer – AI Infrastructure, Agentic Platform

ShiftKey

• Evolving the AI knowledge platform - taking the retrieval, indexing, and synthesis layer (currently semantic RAG + re-ranking + HyDE) to an organization-wide platform serving both internal engineering tools and customer-facing capabilities. • Architecting and operating agentic infrastructure on AWS - multi-step, tool-using AI systems that plan, retrieve, and act on complex queries and operational events, with cost guardrails and observability built in from day one. • Designing and building graph-based, relationship-aware retrieval across the organization's data sources, enabling multi-hop queries and letting agents accumulate organizational knowledge over time. This is on our roadmap, not in production - you will define the approach. • Partnering with product engineering to define the AI platform API surface, translating infrastructure primitives into developer-ready abstractions. • Building reference agent implementations on the platform - operational-incident triage, customer support, and future agentic use cases - grounding each agent's reasoning in institutional knowledge. • Owning the AI infrastructure cost model: monitoring compute, model, and storage spend, flagging anomalies, and proposing guardrails to keep workloads within defined budgets.

Job Requirements

  • 7+ years of professional software engineering experience, with at least 2 years building and operating production AI/LLM application systems - not research, not prototyping, not demos.
  • Retrieval engineering beyond the basics. Our stack already includes re-ranking and HyDE; we need someone who has worked at or above that level: hybrid search, re-ranking, query transformation, context-window management, and evaluation of retrieval quality in production.
  • Working experience with agentic frameworks and multi-step reasoning loops - tool use, iteration control, cost governance, and model routing trade-offs.
  • Production-grade software engineering fluency (strict typing, testing, async/concurrency, modern toolchain) in Go, Python, or TypeScript, with the ability to ramp into another quickly.
  • Hands-on experience operating AI workloads on a managed cloud AI platform (AWS Bedrock or Azure AI Foundry), including the identity/secrets model and model access governance. Bedrock preferred given our AWS stack.
  • Hands-on Terraform experience - able to author and provision new infrastructure independently, not just modify existing modules.
  • Familiarity with production observability for AI systems: metrics, structured logging for model spend and latency, and evaluation harnesses to detect regressions.
  • Understanding of HIPAA-style data-handling requirements in a regulated SaaS environment. Prior healthcare experience is a plus, not a requirement.

Benefits

  • Inclusive and collaborative work environment where all voices are valued.
  • Hybrid-friendly office spaces designed to be fun and engaging.
  • Comprehensive health, vision, and dental coverage.
  • Benefits begin on your first day.
  • Generous PTO and company-paid holidays, including flexible floating holidays.
  • 100% 401(k) employer match up to 6%.
  • Paid parental leave.
  • Wellness support, including access to mental health resources.

Related Categories

Related Job Pages

More Infrastructure Engineer Jobs

Role Description ¿Te motiva diseñar arquitecturas que soporten transacciones de millones de usuarios sin margen de error? ¿Dominas el ecosistema Oracle como pocos y te apasiona blindar sistemas de misión crítica contra cualquier amenaza? En este rol, serás el guardián y el diseñador de la columna vertebral tecnológica de nuestros clientes financieros. Tu día a día estará enfocado en: - Diseñar y liderar la implementación de arquitecturas robustas y escalables utilizando el stack tecnológico de Oracle e infraestructuras híbridas (físico, virtualizado y Cloud Native). - Garantizar la máxima seguridad en cada capa del ecosistema, integrando soluciones de ciberseguridad financiera, criptografía y políticas IAM de última generación. - Optimizar y tunear plataformas de capa media, asegurando el rendimiento óptimo de entornos críticos en WebLogic, SOA Suite y Service Bus. - Guiar la transición y coexistencia hacia entornos Cloud Native en OCI mediante el despliegue de microservicios, contenedores (OKE) e Infraestructura como Código (IaC). Qualifications - Más de 5 años diseñando e implementando arquitecturas de infraestructura Oracle y ciberseguridad, idealmente con proyectos de alta complejidad en el sector financiero. - Dominio de Oracle Cloud Infrastructure (OCI): Experiencia avanzada en VCN, topologías Hub & Spoke, BGP, FastConnect, VPN, cómputo y bases de datos cloud (PaaS). - Sólido manejo de virtualización sobre VMware y configuración de clústeres en Oracle Forms & Reports, Oracle Analytics/BI Publisher y Oracle SOA Suite. - Dominio de Oracle WebLogic Server (versiones 10g a 14c), incluyendo tuning avanzado, clustering, JDBC y Work Managers. Integración experta en Oracle SOA Suite y Service Bus (OSB). - Experiencia en IAM (SSO, federación SAML, OpenID Connect) y seguridad aplicada (PKI, keystores, Cloud Guard, WAF, Vaults, HSM, así como estándares/redes financieras como SWIFT y Apple Pay). - Nivel experto en administración GNU/Linux (RHEL/Debian), despliegues de Kubernetes (OKE), Oracle Functions y automatización mediante Terraform (IaC). - Conocimientos y aplicación de estándares internacionales como NIST, CIS, COBIT e ITIL. Requirements - Certificaciones oficiales como OCI Certified Architect Associate, OCI Certified Security Professional, Oracle WebLogic Server 12c Implementation Specialist o CompTIA Security+ son deseables. Benefits - Salario fijo competitivo acorde a tu expertise de élite. - Modalidad de trabajo flexible: Disfruta del equilibrio con opciones de trabajo remoto/híbrido y horarios que respetan tu vida personal. - Proyectos de verdad desafiantes: Trabajarás con tecnologías de punta en sistemas críticos donde tu aporte se nota de inmediato. - Cultura de autonomía, colaboración y dinamismo: Tu iniciativa se valora, se escucha y se implementa. - Crecimiento continuo: Mentoría constante, apoyo para certificaciones y un plan de desarrollo para que nunca dejes de avanzar.

Latin America (LATAM)
EXANTE logo

Senior Infrastructure Engineer

EXANTE

Global prime broker backed by proprietary technology and dedicated service.

Full TimeRemoteTeam 501-1,000Since 2011H1B No Sponsor

• Operate and maintain on-premises infrastructure based on bare-metal Debian Linux servers • Manage OS-level configuration, networking, and system services • Automate infrastructure provisioning and lifecycle management using Chef • Manage infrastructure state via Git repositories following GitOps principles • Standardize and continuously improve infrastructure deployment workflows • Manage and operate hybrid connectivity across GCP, AWS, Megaport, and on-prem data centers • Design and maintain VPC networking, routing, and firewall rules • Operate hybrid connectivity (Direct Connect, Cloud Interconnect, VPN) • Configure and support BGP routing between cloud and on-prem environments • Ensure high availability, redundancy, and fault tolerance of network connectivity • Troubleshoot network and connectivity issues across cloud and on-prem layers

Georgia
UFS Tech logo

Lead Platform Infrastructure Engineer

UFS Tech

Technology Outfitter for Community Banks. Empowering community banks and our people to thrive - together.

Full TimeRemoteTeam 51-200Since 1991H1B No Sponsor

• Design and own the Infrastructure-as-Code baseline that enables dedicated single-tenant or on-premises deployment with minimal per-customer effort • Stand up and operate Docker and Kubernetes (and K3s for small or in-bank installs), ingress, load balancing, and the CI/CD pipeline • Build and maintain the secrets and certificate story and the observability stack • Define environment promotion, release automation, and rollback procedures — making deployments boring and repeatable • Partner with Security on encryption, network isolation, and exam-ready hardening aligned to regulatory guidance • Right-size and operate GPU and inference infrastructure as the AI workload grows • Establish on-call, SLOs, and capacity planning practices ahead of beta scale-up • Document deployment architecture and operating procedures to support customer due diligence and audit readiness

United States
Focal Systems logo

Infrastructure Engineer

Focal Systems

The Operating System of Retail

Full TimeRemoteTeam 51-200H1B Sponsor

Role Description We are looking for an Infrastructure Engineer to own and evolve the systems that power Focal at scale. We are looking for someone who can architect, build, and operate production infrastructure. - Work on the design, operation, and continuous improvement of Focal's core infrastructure - cloud, data pipelines, deployments, and observability. - Drive meaningful reductions in COGS and latency without sacrificing reliability. - Architect and maintain scalable, data-heavy backend infrastructure built on Python, FastAPI, Kafka, Docker, and cloud platforms. - Build and operate deployment pipelines - blue/green and canary deployments, CI/CD tooling, and release processes that support zero-downtime launches at scale. - Design and implement monitoring and alerting systems that provide genuine visibility into system health across geographies and environments. - Create tooling that gives engineers and stakeholders transparent, easy access to data stored across varying geographic locations and formats. - Collaborate closely with backend, deep learning, and embedded engineering teams to ensure infrastructure evolves with product and model requirements. Qualifications - 5+ years in infrastructure, platform, or DevOps engineering. - Production experience with GCP at scale. - Kubernetes, Helm and Docker in production. - Python - our stack is Python end-to-end. You'll read, debug, and contribute to backend code daily, so a software development background (not just ops scripting) is essential. - Infrastructure-as-code with Terraform. - Observability with Prometheus - metrics, alerting, and instrumentation. - Solid CI/CD fundamentals and deployment strategies (blue/green, canary, feature flags). Requirements - MySQL - a significant bonus; query tuning and operational knowledge stand out. - MongoDB, Kafka (or comparable streaming platforms), CircleCI. - Experience with data-intensive applications and microservices at scale. About you - You take ownership and prioritize well in a startup environment. - You're well-rounded rather than a lone hero - you cover gaps across the stack and reliably own the day-to-day and less-complex work, freeing the team to focus on the hardest problems. - Advanced written and spoken English. - Comfortable coordinating across time zones with a global team. - Comfortable with a shared on-call rotation. Benefits - Competitive Salary & Attractive Stock - Paid Time Off - Team Retreats - Education grants

Europe
$102K - $117.5K / year