AI Automation Engineer, Customer Education
Location
United States
Posted
20 days ago
Salary
$123.6K - $185.4K / year
Seniority
Senior
Job Description
AI Automation Engineer, Customer Education
Harvey
• Build and maintain AI agents using LLM APIs (Anthropic Claude, OpenAI) to automate content creation, review, and publishing workflows across Harvey Academy and the help center. • Own and optimize the learning technology stack, including Skilljar and Sanity CMS integrations, ensuring reliability, extensibility, and seamless content publishing. • Identify and eliminate bottlenecks in content operations by building automation where it doesn't exist yet. • Partner with Product, User Operations, and GTM to identify opportunities for systems improvement and AI-driven innovation across the customer education ecosystem. • Use technical expertise to explore implementation of interactive learning components based on instructional design direction from team members.
Job Requirements
- 5+ years of experience in software engineering or automation engineering, with demonstrated experience designing and building API integrations
- Proficiency with modern web technologies (HTML, CSS, JavaScript, and React or similar), ideally in a fast-paced or high-growth environment.
- Hands-on experience building AI agents, LLM-powered workflows, including prompt engineering and API integrations with platforms like Anthropic Claude or OpenAI.
- Track record of supporting production systems end-to-end, ideally including LMS platforms, CMS tools, or similar content delivery infrastructure.
- Strong ability to operate autonomously, translating business needs into well-architected technical solutions with minimal oversight.
- Excellent communication skills with the ability to collaborate closely with non-technical teammates and explain technical tradeoffs clearly.
- Comfort working in documentation-heavy or content-ops environments
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits (401k match up to 4%)
- Flexible PTO
Related Guides
Related Categories
Related Job Pages
More QA Automation Engineer Jobs
Role Description As an Senior Automation Test Engineer, you will be responsible for designing, developing, and maintaining UI automation frameworks and test scripts for web applications. You will collaborate closely with developers, business analysts, and QA teams to ensure robust test coverage and high-quality software delivery. - Develop, execute, and maintain Selenium WebDriver automation scripts using Java. - Design and implement automation frameworks using BDD and TestNG. - API testing using Rest Assured. - Analyze requirements, identify test scenarios, and automate functional UI test cases. - Perform cross-browser testing and validation across multiple environments. - Debug automation failures, report defects, and collaborate with development teams for issue resolution. - Integrate automated test suites with CI/CD pipelines using tools such as Jenkins, GitHub Actions, or Azure DevOps. - Maintain and manage test data while ensuring script reusability and scalability. - Improve automation coverage, execution efficiency, and reporting capabilities. - Contribute to automation best practices and continuous quality improvement initiatives. - Participate in code reviews and knowledge-sharing sessions within the QA team. Qualifications - Strong proficiency in Core Java including OOP concepts, Exception Handling, Collections, Streams, and Multithreading concepts. - Hands-on experience with Selenium WebDriver, including locators, waits, handling dynamic elements, alerts, frames, and browser interactions. - Experience with API testing using Rest Assured. - Experience with TestNG or JUnit for test execution, reporting, and suite management. - Knowledge of Maven or Gradle for build and dependency management. - Experience using Git for source code management and version control. - Understanding of software testing principles, defect lifecycle, and Agile methodologies. - Strong analytical, troubleshooting, and problem-solving skills. - Excellent communication and collaboration abilities. Requirements - Experience implementing Page Object Model (POM) and Hybrid/Data-Driven Automation Frameworks. - Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps. - Strong understanding of XPath, CSS Selectors, and browser developer tools. - Familiarity with Headless Browser Testing. - Knowledge of automation framework design and reusable component development. - Exposure to API testing and automation is an added advantage. Benefits - We value flexibility and support our employees with remote work options and adaptable schedules to maintain a healthy work-life balance. - Our inclusive culture brings together talented professionals who are passionate about quality engineering, innovation, and continuous learning. - You’ll have access to industry-leading training programs, certifications, and opportunities to work with modern automation technologies, DevOps practices, and cloud-based testing solutions.
Role Description We are seeking a seasoned Senior QA Engineer with a strong background in both automation and manual testing, with proven expertise in Selenium WebDriver and Java-based test automation. This role is pivotal to ensuring the quality and reliability of our SaaS-based HRMS solutions. The ideal candidate will be responsible for leading QA efforts, driving test strategy, building scalable automation frameworks, and contributing to a high-quality Agile development environment. - Lead the end-to-end automation testing efforts using Selenium WebDriver with Java, and support key initiatives across manual testing workflows. - Design, develop, and maintain robust, reusable test automation frameworks for web applications. - Create and execute comprehensive test plans, test cases, and manual/automated scripts ensuring maximum coverage. - Identify, isolate, and thoroughly document bugs, collaborating closely with developers for timely resolution. - Integrate automated tests into CI/CD pipelines (Jenkins/GitHub Actions) and work closely with DevOps to streamline deployments. - Perform cross-browser and cross-platform testing using tools such as BrowserStack or Sauce Labs. - Conduct API testing (manual and automated) using Postman, RestAssured, or similar tools. - Support performance testing efforts (using tools like JMeter) to ensure optimal application behavior under load. - Champion best practices in BDD/TDD, test data management, defect reporting, and test metrics tracking. - Actively contribute to Agile ceremonies (daily stand-ups, sprint planning, retrospectives, demos). - Stay updated on emerging test tools and technologies to improve QA strategy and implementation. - Mentor junior QA engineers and ensure QA standards are consistently met across projects. Qualifications - 7+ years of experience in Software QA, with at least 3+ years in Selenium WebDriver automation using Java. - Expertise in Java programming with strong OOP principles, especially in building automation scripts and frameworks. - Solid hands-on experience with test automation frameworks: TestNG, JUnit, and BDD tools like Cucumber. - Strong command of manual testing techniques, including exploratory, regression, functional, and integration testing. - Proficiency with CI/CD tools: Jenkins, Git, Docker. - Experience with API testing and validation using Postman, RestAssured, or similar tools. - Knowledge of performance testing tools like JMeter is a strong plus. - Experience testing in cloud-based or virtual test environments (BrowserStack, Sauce Labs, etc.). - Familiarity with Agile development methodologies and DevOps practices. - Strong analytical mindset with attention to detail and excellent problem-solving skills. - Exceptional communication skills and ability to work collaboratively with cross-functional teams.
• Plan, design, develop, and test automated processes using RPA product suites • Lead integration of the RPA application with other enterprise systems and data sources • Works closely with business on all technical aspects of an RPA deployment • Identifying new process opportunities and accurately analyze and estimate new processes • Configuring new Automation processes and objects using core workflow principles • Creating and maintaining solution documentation • Supporting existing processes and implementing change requirements • Communicating with Automation software supplier on software related issues
Senior/Lead QA Automation Engineer
AgileEngineAgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
Role Description We are looking for a Senior/Lead QA Automation Engineer to own and evolve automated testing frameworks, introduce AI-assisted QA practices, and define quality engineering strategy across an AI-driven product development environment. You will architect automation across the full testing stack — unit, integration, API, UI, performance, and security — integrate quality gates into CI/CD pipelines, design evaluation frameworks for LLM-based features, and mentor engineers in modern automation and AI-augmented workflows. What You Will Do - Own and evolve the organization’s automated testing framework and QA tooling ecosystem; - Define and standardize AI-assisted testing practices, including test case/data generation, coverage discovery, and responsible AI guardrails; - Implement intelligent test selection, regression analysis, and measurable quality metrics to optimize release quality and reduce risk; - Ensure AI-augmented tests remain deterministic, maintainable, production-ready, and supported by traceability, validation, and drift detection; - Architect and scale automation across unit, integration, API, UI, contract, performance, and security testing; - Champion modern testing principles, integrate automation into CI/CD, and enforce quality gates and release readiness criteria; - Design evaluation frameworks for AI-powered features, including prompt robustness, deterministic validation, and human-in-the-loop review where appropriate; - Lead root-cause analysis for systemic quality issues and continuously improve automation ROI and test effectiveness; - Mentor engineers on modern automation, AI-assisted workflows, prompt engineering, and review standards for AI-generated code; - Define and track QA KPIs, provide data-driven Go/No-Go recommendations, and improve testing strategy based on measurable outcomes; - Partner with Engineering, Product, Security, and DevOps to embed quality early, influence architecture, and integrate accessibility, security, and privacy testing throughout the SDLC. Qualifications - 5+ years of experience in software quality engineering, test automation, or SDET roles; - 3+ years leading automation strategy or serving as a senior technical QA authority; - Hands-on experience using AI tools for test generation, refactoring, and automation maintenance; - Experience evaluating LLM-based systems (prompt robustness, structured outputs, drift detection, and versioned regression suites); - Strong proficiency in at least one programming language (TypeScript, Java, Python, etc.) and modern test frameworks (e.g., Playwright, Cypress, Selenium); - Demonstrated experience designing, maintaining, and scaling test automation frameworks and CI/CD quality gates; - Strong understanding of distributed systems, HTTP lifecycle, and database querying (SQL/NoSQL); - Experience mentoring engineers and leading quality initiatives with measurable outcomes; - Upper-intermediate English level. Requirements - Working knowledge of secure testing practices (OWASP Top 10) and performance testing strategy; - Familiarity with compliance, privacy, or regulated industry SaaS environments; - Experience implementing performance/load testing strategies; - Experience with accessibility testing strategy and tooling. Benefits - Professional growth: Mentorship, TechTalks, and personalized growth roadmaps. - Competitive compensation: USD-based pay with education, fitness, and team activity budgets. - Exciting projects: Modern solutions with Fortune 500 and top product companies. - Flextime: Flexible schedule with remote and office options.


