Your global quality engineering and cyber security partner from initiation to launch.
Senior Automation Tester - Python
Location
United Kingdom
Posted
23 days ago
Salary
0
Seniority
Senior
Job Description
Senior Automation Tester - Python
Resillion
Title: Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid) Location: Birmingham, United Kingdom - Employees can work remotely - Contract - Full Time / Part Time: Full Time Job Description: Company Description At Resillion, our culture is built on a mindset of “if you see something, say something” — taking responsibility and speaking up. We expect everyone to adapt and embrace change as the company grows. We recognise the value of every employee and invest in developing their skills so that, as an organisation, we continue to lead our industry. Above all, it’s a culture driven by passion for what we do and commitment to the bigger picture of the company. If you want to be part of our journey, this role may be the right fit for you Senior Automation Tester (Python) – Agentic AI & LLM Systems Location: Glasgow (Hybrid preferred but not essential) Start Date: Immediate Right to Work: Must have full UK working rights (no sponsorship available due to start dates) Additional Requirement: Must have 3 years of UK address history due to immediate onboarding Programme: AI / Agentic AI Seniority: Senior Automation Engineer Overview We are seeking a Senior Automation Engineer / SDET with strong Python skills and hands‑on experience testing AI systems, including LLM‑driven applications and agentic AI workflows. You will design and build a scalable automation frameworks, implement modern AI testing strategies, and ensure the quality and reliability of next‑generation conversational and agent‑based AI products. This role is ideal for someone who is passionate about automation engineering and has a solid understanding of how AI/LLM systems behave in real‑world scenarios. Key Responsibilities - Develop and maintain a Python‑based automation framework for validating AI agents (chatbots, voicebots, agentic workflows). - Design and execute automated tests for: - LLM responses - Conversational flows - Retrieval‑augmented generation (RAG) - End‑to‑end agentic scenarios - Apply modern AI testing strategies and evaluation methods (e.g., DeepEval, RAGAS — beneficial but not essential). - Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, Azure Repos). - Build and manage batch and scheduled executions using Docker, Kubernetes, cron jobs, or similar tooling. - Manage code repositories using Git, including branching strategies, version control, and collaborative workflows. · Collaborate closely with engineering, AI/ML, and product teams to ensure high‑quality delivery of AI‑powered features. Required Skills & Experience - Strong Python development skills, particularly for automation (PyTest preferred). - Solid background in test automation and framework design. - Experience testing or validating AI/LLM‑based systems (agentic workflows, conversational AI, RAG pipelines, etc.). - Understanding of AI evaluation concepts — familiarity with tools like DeepEval or RAGAS is a bonus, not a requirement. - Experience implementing CI/CD pipelines and automated batch executions. - Strong understanding of source code management, Git workflows, and collaborative engineering practices. - Ability to design structured, scalable, and maintainable automation solutions. Preferred Qualities - Quick learner with a proactive, ownership‑driven mindset. - Strong problem‑solving skills and ability to work in fast‑moving AI environments. - Comfortable collaborating with cross‑functional teams (AI/ML, engineering, product). - Passion for AI technologies and modern testing methodologies.
Related Guides
Related Categories
Related Job Pages
More QA Engineer Jobs
Senior Automation QA Engineer
All Seniors Care Living CentresAll Seniors Care Living Centres is a proudly Canadian, family-run company. "Where Caring Is Our Number One Concern."
• Take full ownership of the existing E2E automation framework (Playwright + WebdriverIO/Appium) • Define and drive the quality strategy across web and mobile platforms • Identify coverage gaps, prioritise test work, and align quality efforts with product releases • Own the Android mobile test suite (WebdriverIO + Appium + uiautomator2) — maintain, extend, and improve reliability • Expand iOS automation coverage, building on work already in progress • Ensure cross-platform parity across our iOS and Android apps • Maintain and extend the Playwright web test suite (Chromium + Mobile Safari) • Own API-level test coverage and webhook validation flows • Own the CI/CD pipelines for automated test runs (self-hosted runners and nightly scheduling) • Improve test reliability, parallelisation, and reporting (Playwright HTML + Allure) • Collaborate with DevOps on environment stability and infrastructure access • Work closely with Product, Engineering, and Design to embed quality early in the development cycle • Translate product requirements into robust test coverage with a clear risk focus • Communicate clearly about automation coverage, gaps, and trade-offs to both technical and non-technical stakeholders
Senior Quality Engineer
Magnite, Inc.Founded in 2007, Magnite, Inc. is a prominent player in advertising technology. The company offers digital solutions that empower publishers to boost revenue th
Senior Quality Engineer Location: New York City, NY, Los Angeles, CA, Broomfield, CO, Buffalo, NY, United States Full time job requisition id R-01313 Job Description: Hybrid Schedule (M/F remote, T/W/TH in-office) At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ: MGNI) is the world's largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day! About this team: We are looking for a Senior Quality Engineer to join our Streaming Ad Server team to help ensure quality is baked into the entire Software Development Lifecycle. On this team you will work on a globally distributed ad serving system that handles hundreds of billions of requests a day. You have the opportunity to take on project initiatives to improve the confidence, stability and delivery of our systems, tackle hard technical challenges, and contribute to a team of passionate individuals. In this role you will: - Test Strategy & Design: Develop and lead effective test strategies for complex, large-scale integration projects by thoroughly analyzing software systems. - Test Plan & Automation Framework Development: Architect, build, and maintain scalable, robust automated testing frameworks using industry-standard tools to support continuous integration and delivery (CI/CD) processes. - Automation Implementation: Create and implement automated tests that execute key test strategies, ensuring they are repeatable, maintainable, and robust. Step in with manual testing when automated solutions aren't feasible. - AI-Driven Test Coverage & Tooling: Pioneer the use of AI techniques (e.g., fuzzing, model-based testing, generative AI) to automatically create comprehensive test cases and significantly increase coverage for complex, large-scale systems.1 - Intelligent Test Automation Development: Architect and implement AI-powered custom testing tools, such as self-healing frameworks and intelligent defect prediction systems, to enhance the robustness and efficiency of the automated testing ecosystem - CI/CD Integration: Collaborate closely with DevOps to integrate automated testing into CI/CD pipelines, optimizing the delivery process. - Troubleshooting & Debugging: Utilize strong troubleshooting skills to isolate and resolve issues, perform root cause analysis, and validate bug fixes to ensure smooth releases. - Cross-Functional Collaboration: Partner with product, project, and development teams to identify, assess, and address technical, business, and process-related issues that impact quality. - Innovation & Research: Stay at the forefront of testing technology by researching and developing proofs of concept for new tools, methodologies, and best practices. - Quality Assurance Ownership: Take end-to-end responsibility for quality assurance by managing the QA sign-off process for releases. We're looking for someone with: - QA & Automation Experience: 5+ years of demonstrated hands-on experience in software QA and test automation, exhibiting continual technical growth, increasing responsibility, and a track record of driving significant improvements to testing practices. - Experience in AI/Automation Integration: Proven ability to integrate Artificial Intelligence methodologies into existing test automation frameworks to expand coverage and reduce maintenance overhead. - Education: Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. - CI/CD & Release Management: Proven experience with CI/CD pipelines and release management tools. - API Testing: Strong ability to design and implement API smoke, regression, and end-to-end tests, ensuring robust integration across components. - Backend & Service Testing: Solid understanding of backend and service testing, with a focus on performance, scalability, and security. - Programming Languages: Proficiency in Python and/or Java, along with experience in scripting languages. - Infrastructure & Observability: Familiarity with cloud infrastructure, distributed systems, and observability tools to support monitoring and debugging. Nice to Have: - Experience with the Ad Tech industry. - Exposure to specialized tools or platforms used for prompt engineering and utilizing generative AI to accelerate test script creation or synthetic data generation. - Practical experience with AI tools or frameworks leveraged for predictive quality metrics, root cause analysis, or optimization of test execution. - Hands-on experience with AWS services for deploying, testing, and monitoring applications in cloud environments. In the US, the base salary range for this role is $135,000 - $165,000. Actual compensation will be determined based on location, experience, skills, and internal equity. This role is also eligible for: - Annual performance-based bonus - Equity (NASDAQ: MGNI) - Comprehensive benefits package During the interview process, candidates will receive more specific information about the salary range applicable to their experience and location. Perks and Benefits: - Comprehensive Healthcare Coverage from Day One - Generous Time Off - Holiday Breaks and Quarterly Wellness Days - Equity and Employee Stock Purchase Plan - Family-Focused Benefits and Parental Leave - 401k Retirement Savings Plan with Employer Match - Disability and Life Insurance - Cell Phone Subsidy - Monthly Fitness and Reimbursement Career Growth: We support internal mobility, skill development, and leadership pathways through structured career frameworks and learning programs. Company Culture: Magnite's culture is rooted in collaboration and connection, recognizing that both are essential to success. Our hybrid schedule includes two remote workdays (Monday and Friday) and three in-office days (Tuesday through Thursday), where employees can take advantage of catered lunches, beverages, snacks, training opportunities, and engaging office events that enhance the work experience. In addition, we support our team through meaningful benefits and programs, including community service and volunteer opportunities, company-matched charitable contributions, access to mental health resources, structured career development initiatives and growth frameworks, culture and inclusion programs, and our Bonusly peer-to-peer recognition platform. About Us The world's leading agencies and brands trust our platform to access brand-safe, high-quality ad inventory and execute billions of advertising transactions each month. Anchored in bustling New York City, sunny Los Angeles, mile-high Denver, historic London, and down under in Sydney, Magnite has offices across North America, EMEA, LATAM, and APAC. For Los Angeles-based applicants: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. The material job duties of this specific job position for which Magnite reasonably believes that a criminal history may have a direct, adverse, and negative relationship include: - Having access to the Company's Confidential Information or trade secrets including data related to customers, clients, vendors, business partners, or suppliers - Work with cross teams to access datasets, databases, formulas, algorithms, tools, products, prototypes, systems applications, and technologies in any stage of development Magnite is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other federal, state or local protected class. Our Commitment: We aim to incorporate a wide range of voices into our Magnite culture, cultivating an environment where employees feel welcomed, cared for, and encouraged to freely share ideas. We are committed to employee growth, collaboration, inclusion, and innovation. We invest in Magnite's local communities. We seek talent from all backgrounds to champion corporate values of seeing the big picture and being catalysts of change.
Middle Automation Tester in Java for Media Company
EPAM SystemsEPAM Systems is an information technology (IT) company that has become a leading global digital and product design, digital platform engineering, and product development agency. As
Title: Middle Automation Tester in Java for Media Company Location: Albany United States Job Description: Currently, we are looking for a Remote Middle Automation Tester in Java to join our team. Responsibilities - Support of the existing test automation framework - Writing new and updating existing test scripts for iOS and Android native application - Triaging and analysing automation run results - Collaboration with testers during automating process Requirements - 2+ years of Automated Testing in Java experience - Experience in Mobile Testing - 2+ years of Core Java - 2+ years of Appium experience - Knowledge of OOP, design patterns and programming principles to be able to follow the existing framework - Experience in Test NG, Gradle, Wiremock, BrowserMob Proxy, Jira/ Jira API, Report Portal, Jenkins, Git - The candidate should understand XML/XPATH, JSON - Working with the terminal (experience with macOS/Linux installation, deletion, program settings), basic network knowledge - Good attitude to complex logic projects, strong problem solving skills - Should be able to work without supervision - Good communication skills and work in team - Experience with MacOS, Android, iOS We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
Senior QA Manual Engineer – AI, Manufacturing
NagarroNagarro (Frankfurt: NA9) is a leader in digital product engineering and drives technology-led business breakthroughs.
• Act as a QA Analyst for AI-driven projects. • Perform end-to-end testing of AI-based applications and workflows. • Validate systems that process and transform complex business and technical requirements. • Ensure quality of solutions involving data extraction, rule-based logic, and generated outputs. • Test NLP-based interfaces for accuracy, usability, and recommendations. • Collaborate closely with Business, Functional, and IT teams.



