• Design and execute comprehensive test plans for backend services, APIs, and microservices architectures. • Partner with Backend Engineers, AI Engineers, and Product teams to understand requirements and identify quality risks early in the development cycle. • Develop automated testing frameworks using tools like Pytest, Playwright, unittest, and integration testing libraries. • Build end-to-end test suites that validate the integration between backend systems, AI agents, databases & services. • Advocate for quality-first practices, influencing architectural decisions and embedding testing into the development lifecycle. • Design and implement automated evaluation frameworks for Generative AI features, including LLM / SLM model testing, prompt/ output validation, and behavioral assessment of agentic workflows. • Develop quality metrics and evaluation methodologies for LLM-based applications, assessing accuracy, consistency, reliability, quality of AI/ML models. • Create and maintain curated evaluation datasets and synthetic test data that cover edge cases, adversarial scenarios, and real-world variability. • Leverage AI evaluation tools and frameworks & establish observability and monitoring requirements to quality assessment. • Establish observability and monitoring requirements including structured logging, metrics collection, and tracing for both backend services and AI agent behavior. • Implement quality gates and acceptance criteria and create test documentation including test plans, automation architecture, quality reports, and runbooks. • Build strategies for testing in cloud environments & containerized execution. • Implement performance testing, load testing, and reliability testing for production backend services and AI inference pipelines. • Define and champion quality standards, best practices, and testing methodologies for both traditional backend systems and AI applications. • Conduct code reviews with a focus on testability, quality patterns, and maintainability. • Mentor junior quality engineers, sharing expertise in automation frameworks, AI testing approaches, and quality engineering principles. • Communicate quality insights, risk assessments, and test results effectively to technical and non-technical stakeholders using tools like Jira and Confluence.

• Assist Associate QAs with test scripts creation to accurately evaluate all functional criteria • Work with Associate and Senior QAs to provide detailed documentation of testing results for all stories and features • Assist in and eventually take ownership of authoring UAT scripts • Participate in UAT preparation and troubleshooting • Work closely with development team and clients to understand functionality, communicate testing results, and at times demo functionality to users • Work an agile framework, collaborating with other quality assurance testers, business analysts, developers, training team, and product owner to ensure solutions meet client needs with the highest quality. • Test integrations

Trilogy Federal drives innovative solutions for complex business challenges across financial management, healthcare, and government industries. Our collaborative, client-first service approach, combined with our commitment to the rapid implementation of pragmatic solutions, has earned Trilogy an unparalleled reputation for delivering transformative results. We are seeking an experienced Senior Business Intelligence (BI) Testing Analyst for an opportunity with a large federal customer. The ideal candidate will have a proven track record of experience supporting Momentum and Financial Reporting testing and implementation activities in large ERP programs for a federal agency. The Senior BI Testing Analyst will support the BI Test Lead and the program by performing testing activities for an implementation release as part of the overall program. The Senior BI Testing Analyst should be a self-starter who can work independently and as a part of a team, and has experience in taking ownership of work assignments and project schedules. This position is remote but may require occasional domestic business trips to customer facilities primarily in Washington, DC and Austin, TX. Some overtime work may be required to support this fast-paced environment. Primary Responsibilities: - Collaborate with the BI Test Lead and government client in planning, training, and testing of reporting and data extracts for the financial system and coordinate with other vendors on testing to adjudicate, resolve, and close issues. - Review existing test plans and develop an updated testing plan for the BI components of each implementation release. - Develop system test scripts for key reports in that implementation release, including the use of automated testing tools. - Maintain and prioritize a testing defect log that will be shared with the government client and other vendors to track testing progress. - Support BI and reporting components of User Acceptance Testing (UAT) training. Minimum Requirements: - Bachelor’s degree - 8 years of experience supporting Momentum and/or Power BI Financial Reporting implementation activities at a large federal agency. - 4 years supporting Momentum Financials or other ERP system. - 4 years of related experience executing test scripts, documenting test results, and identifying issues.   - Strong written and oral communication skills. - Strong analytical skills and a desire to enhance those skills in a challenging, high visibility environment. - Ability to obtain a Public Trust clearance. Preferred Qualifications: - Experience with the Department of Veterans Affairs. - Experience with Agility for testing. - Experience with automated testing tools for Power BI and other reporting tools. Benefits (including but not limited to): - Health, dental, and vision plans - Optional FSA - Paid parental leave - Safe Harbor 401(k) with employer contributions 100% vested from day 1 - Paid time off and 11 paid holidays - No cost group term life/AD&D plan, and optional supplemental coverage - Pet insurance - Monthly phone and internet stipend - Tuition and training reimbursement $115,000 - $130,000 a year This range is not a guarantee of compensation or salary, as Trilogy Federal conducts an individual equity review for every candidate based on experience, location, education, industry experience, and comparisons to internal pay bands. In addition to salary, Trilogy offers robust benefits including medical/dental/vision insurance coverage, 401(k) match, paid holidays, paid time off, tuition reimbursement, and a very supportive work/life balance. Regarding remote positions, Trilogy Federal is able to offer virtual employment in the following states: Colorado, Connecticut, D.C., Florida, Georgia, Illinois, Maryland, New York, South Carolina, Texas, and Virginia. Trilogy Federal is an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Trilogy Federal drives innovative solutions for complex business challenges across financial management, healthcare, and government industries. Our collaborative, client-first service approach, combined with our commitment to the rapid implementation of pragmatic solutions, has earned Trilogy an unparalleled reputation for delivering transformative results. We are seeking an experienced Senior Momentum Testing Analyst for an opportunity with a large Federal customer. The ideal candidate will have a proven track record of experience supporting Momentum testing and implementation activities in large ERP programs for a Federal agency. The Senior Momentum Testing Analyst will support the Testing Lead and the program by developing test plans and executing testing activities for an implementation release as part of the overall program. This will include system integration testing, regression testing, and User Acceptance Testing (UAT). The Senior Momentum Testing Analyst should be a self-starter who can work independently and as a part of a team, and has experience in taking ownership of work assignments and project schedules. This position is remote but may require occasional domestic business trips to customer facilities primarily in Washington, DC and Austin, TX. Some overtime work may be required to support this fast-paced environment. Primary Responsibilities: - Collaborate with the Wave Testing Lead and government client in planning, training, and testing of functional components of the financial system and coordinate with other vendors on testing to adjudicate, resolve, and close issues. - Review existing test plans and develop an updated testing plan for new requirements and interfaces for each implementation release. - Execute manual and automated test scripts, document results, identify issues and defects, and prepare testing summary reports. - Link test cases to Requirements Traceability Matrix (RTM). - Maintain and prioritize a testing defect log that will be shared with the government client and other vendors to track testing progress. - Prepare materials and support facilitation of User Acceptance Testing (UAT) training. Minimum Requirements: - Bachelor's degree - 8 years experience working with Momentum Financials or other ERP system - 4 years of related experience executing test scripts, documenting test results, and identifying issues.   - Knowledge of federal financial business processes and understanding of testing strategies and methodologies. - Strong written and oral communication skills. - Strong analytical skills and a desire to enhance those skills in a challenging, high visibility environment. - Ability to obtain a public trust clearance.  Preferred Qualifications: - Experience with Department of Veterans Affairs.  - Experience using Agility for requirements or testing. - Experience with automated testing tools such as Selenium, Cucumber, Eggplant, or Katalon. Benefits (including but not limited to): - Health, dental, and vision plans - Optional FSA - Paid parental leave - Safe Harbor 401(k) with employer contributions 100% vested from day 1 - Paid time off and 11 paid holidays - No cost group term life/AD&D plan, and optional supplemental coverage - Pet insurance - Monthly phone and internet stipend - Tuition and training reimbursement $116,000 - $130,000 a year This range is not a guarantee of compensation or salary, as Trilogy Federal conducts an individual equity review for every candidate based on experience, location, education, industry experience, and comparisons to internal pay bands. In addition to salary, Trilogy offers robust benefits including medical/dental/vision insurance coverage, 401(k) match, paid holidays, paid time off, tuition reimbursement, and a very supportive work/life balance. Regarding remote positions, Trilogy Federal is able to offer virtual employment in the following states: Colorado, Connecticut, D.C., Florida, Georgia, Illinois, Maryland, New York, South Carolina, Texas, and Virginia. Trilogy Federal is an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.