TechSurge Private Limited

• Design and own the end-to-end QA strategy for the Conversational Banking Platform, covering functional, regression, performance, security, and AI-specific evaluation. • Build and maintain golden datasets, eval suites, and LLM-as-judge frameworks to validate conversational quality across intents, languages, and tenants. • Define the tenant onboarding QA gate, the certification checklist every new business unit must pass before going live. • Establish regression strategies for prompt changes, model upgrades, retrieval index updates, and guardrail policy changes. • Use Langfuse traces to drive evaluation: mine production failures, convert them into test cases, and close the loop with engineering. • Test NeMo Guardrails configurations against jailbreaks, prompt injection, off-topic drift, and false-positive over-blocking. • Validate governance and compliance behaviors: data residency, PII handling, regulated-product disclosures, and off-limits topics. • Build automated test harnesses for Spring AI services, including tool-calling validation, RAG groundedness, and integration with Cosmos DB and MongoDB data layers. • Partner with the Platform team on quality metrics, SLOs, and the platform eval scorecard. • Coach feature engineers and tenant teams on writing their own evals, making platform-grade quality self-service over time.

• Must have Good understanding of Cross Border Payments, Global Transaction Banking, Remittances, Cash Management, Trade Finance and FX, including FX Forwards. • Drive the implementation for any fintech Product set acting as PM for TBFX. • Good Knowledge and understanding of Transaction Banking business across FI and Corporates, along with primary level of knowledge of markets, Forex flow business. • Help Develop and document business strategy for the Transaction Banking FX product proposition. • Work with external partners which help enhance the product offering and client experience. • Good presentation skills along with the deep knowledge of all business tools i.e. Excel, Workflow Tools , power point etc. • Defining business requirements and reporting them back to stakeholders. • Work with various stakeholders (other TB product managers, Financial market product managers, coverage and sales partners) to co-create and develop unique TBFX related solutions. • Expert in FX and payment pricing impact pricing for bulk payment and real time payment. • Excellent understanding of managing FX risk and settlement risk. • Excellent understanding on payment rail and payment settlement mechanism.