• Deploy and optimize LLMs (GPT, LLaMA, Mistral, Falcon, etc.) post-training from libraries like HuggingFace • Utilize inference runtimes such as ONNX Runtime, vLLM for efficient execution. • Optimize batching, caching, and tensor parallelism to improve LLM scalability in real-time applications. • Develop and maintain high-performance inference pipelines using Docker, Kubernetes, and other inference servers.

• Collaborate with and support our creative, tight-knit development team • Design, deploy, and operate Loadsmart's critical systems while balancing reliability, cost, and agility • Play a key role in driving reliability projects with engineering teams • Utilize your intuitive problem-solving skills and contagious positive attitude to tackle challenging and exciting issues, inspiring those around you • Collect metrics and understand their business impact, encouraging the team to do the same • Perform troubleshooting and root-cause analysis of system operation issues • Be accountable for the platform's Service Level Agreements and Objectives • Provide infrastructure support during off-hours as needed • Take ownership of software infrastructure projects • Seek, give, and receive constructive feedback through code and specification reviews.

• Design, build, and maintain cloud environments within Microsoft Azure using best practices for scalability, reliability, and cost efficiency. • Implement and manage IaC using Terraform to automate resource provisioning and environment configuration. • Deploy and manage Azure resources including Azure Kubernetes Service (AKS), App Services, Function Apps, Azure API Management, Virtual Networks, Load Balancers, Storage Accounts, and Azure SQL Server / Azure SQL Databases. • Build and maintain CI/CD pipelines using Azure DevOps for application deployments, infrastructure, and automated testing. • Collaborate with development teams using C#, .NET, Visual Studio, and Angular to optimize the build, test, and release processes. • Integrate pipelines with container registries, package management, and automated approval workflows. • Develop container strategies using Docker and manage workloads running on Kubernetes (AKS). • Implement best practices for scaling, monitoring, logging, and securing Kubernetes clusters. • Monitor system performance, troubleshoot issues, and implement improvements to enhance reliability and uptime. • Manage Linux-based infrastructure, ensuring proper configuration, patching, and hardening. • Work with SQL Server databases to support deployments, migrations, and performance optimization. • Implement secure configurations for Azure resources and Kubernetes clusters while enforcing governance policies, identity and access controls, and environment standards. • Ensure compliance with organizational and industry security requirements.

• Design, build, and maintain cloud environments within Microsoft Azure using best practices for scalability, reliability, and cost efficiency. • Implement and manage IaC using Terraform to automate resource provisioning and environment configuration. • Deploy and manage Azure resources including Azure Kubernetes Service (AKS), App Services, Function Apps, Azure API Management, Virtual Networks, Load Balancers, Storage Accounts, and Azure SQL Server / Azure SQL Databases. • Build and maintain CI/CD pipelines using Azure DevOps for application deployments, infrastructure, and automated testing. • Collaborate with development teams using C#, .NET, Visual Studio, and Angular to optimize the build, test, and release processes. • Integrate pipelines with container registries, package management, and automated approval workflows. • Develop container strategies using Docker and manage workloads running on Kubernetes (AKS). • Implement best practices for scaling, monitoring, logging, and securing Kubernetes clusters. • Monitor system performance, troubleshoot issues, and implement improvements to enhance reliability and uptime. • Manage Linux-based infrastructure, ensuring proper configuration, patching, and hardening. • Work with SQL Server databases to support deployments, migrations, and performance optimization. • Implement secure configurations for Azure resources and Kubernetes clusters while enforcing governance policies, identity and access controls, and environment standards. • Ensure compliance with organizational and industry security requirements.