LLM Integration & CI/CD Engineer-- Senior Associate-AI Managed Services - operate
Location
India
Posted
48 days ago
Salary
0
Seniority
Senior
No structured requirement data.
Job Description
LLM Integration & CI/CD Engineer-- Senior Associate-AI Managed Services - operate
PwC
Industry/Sector Not Applicable Specialism Managed Services Management Level Senior Associate Job Description & Summary At PwC, our people in managed services focus on a variety of outsourced solutions and support clients across numerous functions. These individuals help organisations streamline their operations, reduce costs, and improve efficiency by managing key processes and functions on their behalf. They are skilled in project management, technology, and process optimization to deliver high-quality services to clients. Those in managed service management and strategy at PwC will focus on transitioning and running services, along with managing delivery teams, programmes, commercials, performance and delivery risk. Your work will involve the process of continuous improvement and optimising of the managed services process, tools and services. Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn’t clear, you ask questions, and you use these moments as opportunities to grow. Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to: - Respond effectively to the diverse perspectives, needs, and feelings of others. - Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems. - Use critical thinking to break down complex concepts. - Understand the broader objectives of your project or role and how your work fits into the overall strategy. - Develop a deeper understanding of the business context and how it is changing. - Use reflection to develop self awareness, enhance strengths and address development areas. - Interpret data to inform insights and recommendations. - Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements. LLM Integration & CI/CD Engineer API Integrations | CI/CD Pipelines | Release Engineering | AWS and Secure Delivery Purpose: Build, operate, and improve the integrations and deployment paths that keep AI workloads stable, supportable, and safely releasable. Role LLM Integration & CI/CD Engineer Level AC - Senior Tower AI Operations & Platform Support (AI Managed Services) Experience 6+ years in DevOps, release engineering, API integration engineering, or a similar L2/L3 support role Work Location Bangalore / Hyderabad, India (Remote) Key Platforms AWS, GitHub Actions / Jenkins / Azure DevOps, OpenAI / Bedrock integrations, ITSM and observability tooling Role profile Senior hands-on engineer who can troubleshoot integrations, operate CI/CD pipelines, and support controlled releases in an enterprise-managed-services model. Primary focus APIs and connectors, deployment pipelines, secrets and IAM, release governance, rollback readiness, and L2/L3 troubleshooting. Best fit Someone who can balance speed with control, understands why releases fail, and can drive issues to closure across engineering, platform, and security stakeholders. Role Summary As an LLM Integration & CI/CD Engineer, you will support the non-production to production path for in-scope AI services and integrations. You will help build and operate repeatable deployment patterns, investigate pipeline and connector failures, coordinate release readiness, and improve the reliability and maintainability of the integration landscape. We are looking for engineers who do not just deploy code, but can reason through operational risk, rollback paths, configuration dependencies, and stakeholder impacts. Key Responsibilities 1. Integration and connector engineering - Build, support, and troubleshoot API-based integrations across in-scope AI platforms and enterprise systems. - Implement resilient integration patterns such as retries, idempotency, error handling, timeouts, and operational telemetry. - Work through authentication, configuration, payload, and dependency issues across application and platform boundaries. 2. CI/CD and release operations - Build and maintain CI/CD pipelines for AI workloads and supporting services, with clear validation, promotion, and rollback steps. - Operate pipelines in line with change and release governance and support safe promotion through environments. - Standardize templates, checks, and reusable workflows to reduce release risk and improve consistency. 3. Secure delivery and operational readiness - Implement secure secrets handling, service-account management, and least-privilege access patterns for integrations and pipelines. - Coordinate release readiness activities including deployment plans, rollback paths, runbook updates, and post-release verification. - Support high-risk or time-sensitive changes in partnership with the incident commander and broader platform team. 4. Troubleshooting and continuous improvement - Provide L2/L3 support for pipeline failures, integration defects, and deployment-related incidents. - Drive corrective actions that improve supportability, reliability, and developer experience without weakening controls. - Maintain pipeline and integration documentation, escalation paths, and common-failure reference material. Preferred Skills and Experience Skill area Preferred background API and integration engineering Hands-on experience designing, supporting, and troubleshooting APIs, connectors, webhooks, and enterprise integrations. CI/CD and DevOps Experience building and operating CI/CD pipelines using tools such as GitHub Actions, Jenkins, Azure DevOps, or similar. Cloud deployment patterns Working knowledge of AWS services and deployment patterns for enterprise applications or AI workloads, including configuration promotion and operational validation. IAM and secrets management Experience implementing secure delivery practices using least privilege, secrets management, service accounts, RBAC, and approvals. Release and change governance Experience operating within ITIL-aligned incident, request, release, and change-management processes. Critical thinking and stakeholder engagement Ability to reason through ambiguous failures, synthesize technical and operational risk, and work effectively with platform owners, security teams, and business stakeholders. Nice to Have • Experience with Terraform or adjacent infrastructure-as-code tooling. • Familiarity with Bedrock, OpenAI, or other enterprise GenAI service integrations. • Experience supporting post-deployment validation, rollback exercises, and emergency changes. • Strong working knowledge of ServiceNow or similar ITSM tooling. Working Style & Core Behaviors - Approaches failures methodically and can separate symptom from cause. - Understands that stable delivery is as important as fast delivery. - Is comfortable driving follow-ups across multiple resolver groups and does not wait passively for answers. - Documents patterns and fixes so the team becomes less dependent on tribal knowledge. What Good Looks Like - Can diagnose whether a failed release is caused by code, config, IAM, pipeline logic, or environment drift. - Creates deployment patterns that are easy to support, easy to validate, and easy to roll back. - Improves integration resilience rather than repeatedly fixing the same class of issue. - Keeps change execution controlled while still helping the team move quickly. Team Context You will join PwC’s AI Operations & Platform Support team supporting clients’ run-state AI environment. The operating model is centered on Level 2 and Level 3 support, monitoring, incident response, service requests, minor enhancements, and continuous improvement across AWS/Bedrock, OpenAI, and related platform components. This role will work in a managed-services model focused on incident management, service requests, monitoring, minor enhancements, knowledge management, and continuous improvement. Success depends not only on technical skill, but also on ownership, collaboration, and the ability to engage stakeholders to progress work. Travel Requirements 0% Job Posting End Date
Related Guides
Related Job Pages
More LLM Engineer Jobs
Modern Infrastructure Sales Executive
World Wide Technology Healthcare SolutionsFounded in 1990, World Wide Technology (WWT) is a global systems integrator with $13.4 billion in annual revenue that provides digital strategy, innovative technology and supply chain solutions to large public and private organizations.
Role Description As a Modern Infrastructure Sales Executive, your mission is to guide our customers through the modernization of their infrastructure, unlocking new opportunities and overcoming technological and business barriers. You will work closely with account teams to develop and implement advanced Datacenter, AI, and storage hybrid infrastructures, public cloud, and security solutions. Qualifications - 10+ years of experience successfully selling technology solutions in dedicated sales or technical pre-sales roles. - Extensive experience aligning business objectives and initiatives with relevant technology requirements. - Proven track record in identifying, developing, and driving sales for legacy infrastructure environments, including compute, storage, and networking within Data Center infrastructure. - In-depth knowledge of Cisco product lines and solutions as they pertain to modern infrastructure needs. - Strong expertise in Data Center, hybrid cloud, and public cloud models, with experience across Azure, AWS, Google, and Managed Services. - Adept at building relationships and engaging with customer decision makers involved in infrastructure modernization efforts. - Demonstrated ability to manage relationships at all organizational levels and effectively mobilize stakeholders to achieve critical deliverables. - Exceptional communication skills, especially in conveying complex modern infrastructure concepts. - Recognized demand generation capabilities, focused on proactive selling rather than solely responding to existing demand. - Documented success in developing and increasing sales for Managed and Professional Services offerings. - Creative, strategic thinker with a client-focused service approach. - Willingness and ability to travel frequently within a designated Sales District, up to 25% of the time. Requirements - Grow and develop Hybrid IT Solutions and Services that include a mix of Data Center, Networking, Public Cloud, Professional Services, and/or Managed Services. - Leverage the challenger Sales methodology and an insights-driven sales process, along with a current knowledge of industry and technical trends, to customize solutions for customer needs and business goals. - Collaborate with District Sales Teams and Leaders to create and execute a strategy to acquire new opportunities within targeted accounts. - Build and maintain account and market penetration plans on assigned accounts. - Quarterback opportunities from the point of assessing customer needs through closing deals and driving diversification. - Engage pre-sales and internal support to provide outstanding, end-to-end service. - Nurture strategic relationships with key Hybrid IT partners and vendors. Benefits - Competitive perks that start on day one. - Incentives including cell allowances, annual bonus, or commissions. - Comprehensive benefits plan. Company Description Softchoice is a software-focused IT solutions and services provider that equips organizations to be agile and innovative. We support our people through career development and advancement, and we are recognized for our culture of inclusion and belonging.
VP Analyst, AI Infrastructure – Heads of I&O
GartnerWe deliver actionable, objective insight that drives smarter decisions and stronger performance.
• Create innovative, thought provoking, and highly leveraged “must-have insight” content • Develop new insights and ideas through thought leadership and offer compelling, actionable approaches to client's needs and requests that accelerate the client's ability to act • Develop in-depth analysis to identify the root cause of a client’s barriers or overall needs and reframe thinking to drive strategy forward • Demonstrate thought leadership in establishing insight positions across a team of analysts • Bring provocative, independent insights to Gartner leaders that can evolve the course of a research agenda • Research, analyze and predict market trends and shifts to provide clients and vendors with actionable insights • Provide clients and prospects with actionable advice aligned to their designated content area via virtual or face-to-face interactions • Create and deliver high value presentation materials on and off stage for Gartner events, industry and professional association conferences, and client briefings • Support BTI and Sales: Provide sales support serving as voice of the market to help Insights teams create content and to drive engagement with clients to make progress against their critical priorities to grow their business • Provide high quality and timely content peer review • Build credibility as an industry expert to represent Gartner insights, methodology and strategy • Actively participate in innovation, ideation, and research discussions and collaborate effectively with peers in the Insights community • Identify research process improvements or develop new processes that help the team and BTI provide excellent service delivery • Be a mentor and a coach by supporting more junior team members • Be client-centric while actively seeking to help clients engage regularly and often with Gartner insights and interactions
• Manage a team of 7-10 engineers, run delivery cycles, and drive execution quality • Lead design and hands-on implementation of production-grade generative AI systems - agentic workflows, multi-step RAG pipelines, and LLM-powered applications integrated with enterprise data • Actively upskill engineers on GenAI concepts, patterns, and practices through pairing, code review, and hands-on demonstration • Own operational outcomes for production AI systems - reliability, latency, throughput, cost efficiency, and scalability targets • Collaborate with cross-functional stakeholders to align engineering execution with the broader product data and AI strategy
• Design and build production-grade generative AI systems - agentic workflows, multi-step RAG pipelines, and LLM-powered applications integrated with enterprise data and services • Define and implement reusable engineering patterns for prompt management, workflow versioning, structured outputs, tool orchestration, and rollback across production AI services • Apply judgment around model selection and routing, token and latency optimization, cost management, and the appropriate boundaries between AI-driven and deterministic application logic • Continuously evaluate emerging AI models, tools, and architectural approaches, incorporating improvements into existing systems incrementally • Integrate AI systems with enterprise data sources, internal APIs, and platforms to enable reliable, production-ready workflows • Own operational outcomes for production AI systems - reliability, latency, throughput, cost efficiency, and scalability targets • Implement and maintain monitoring, observability, tracing, and alerting frameworks to ensure operational visibility and rapid issue resolution • Design and maintain CI/CD pipelines for deployment, versioning, and release management of AI services • Lead production incident response and root cause analysis, driving systemic improvements that reduce recurrence • Build and maintain automated evaluation pipelines for LLM outputs - prompt regression testing, retrieval quality validation, and failure mode tracking • Implement human-in-the-loop controls, content guardrails, schema validation, and structured output enforcement to ensure trusted and auditable AI outputs • Secure AI systems against prompt injection, data leakage, and unauthorized access, aligning with enterprise compliance and security standards • Own the team's GenAI technical direction - defining and enforcing engineering standards, patterns, and best practices across all GenAI workstreams • Make and defend architectural decisions with clarity, providing the technical rationale needed for the Manager and stakeholders to align and move forward confidently • Work closely with the Manager, GenAI Engineering to receive, refine, and execute on scoped GenAI work - contributing technical judgment to prioritization and tradeoff decisions • Provide hands-on code review and technical guidance to engineers contributing to GenAI workstreams, raising overall quality through direct feedback and demonstration • Champion an iterative delivery culture - shipping incrementally, incorporating feedback, and improving continuously in a regular production release cadence


