The all-in-one sales & marketing platform that agencies can white-label. CRM, Email, 2-way SMS, Funnel Builder, & more!
Software Development Engineer in Test III – AI
Location
India
Posted
62 days ago
Salary
0
Seniority
Senior
Job Description
Software Development Engineer in Test III – AI
HighLevel
• Design, develop, and maintain automation frameworks and test strategies for AI products • Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations) • Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance • Leverage AI automation tools to optimize test coverage and efficiency • Collaborate closely with developers, product managers, and AI researchers to ensure high-quality releases • Own tasks end-to-end, working independently to deliver on commitments. • Mentor and guide junior SDETs, fostering a culture of quality and continuous learning
Job Requirements
- 5+ years of overall experience in QA/SDET roles
- Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)
- Strong understanding of testing AI/ML products and their unique challenges
- Hands-on knowledge of RAG pipelines and their testing methodologies
- Proficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)
- Experience with API testing (Postman, REST, GraphQL, gRPC)
- Strong problem-solving skills with the ability to work independently
- Mentorship and leadership skills in guiding peers or junior engineers
Related Guides
Related Categories
Related Job Pages
More SDET Jobs
• Take part in testing activities in the Scrum Team and assist in the successful execution of testing strategies. • Develop and promote testing knowledge within an Agile team and provide needed help in enabling developers to test. • Share experience on a variety of testing tools relevant to the business environment and drive experimentation towards improvements. • Define and maintain metrics and promote testing awareness within Engineering. • Promote a shift-left approach in testing across Engineering. • Drive Test Data definition and develop scalable frameworks and tools to solve problems. • Review requirement specifications and user stories to provide timely and meaningful feedback. • Design, development and execution of automation scripts and Test Automation frameworks (Cypress, Playwright, Rest Assured, etc.). • Work on the continuous integration of scripts (Jenkins) and drive the team towards continuous testing. • Identify, document and track issues. • Work closely with Software/Test Engineers and Product Managers to understand context and drive automation and testing to meet objectives. • Take part in exploratory testing and test design sessions to help in improving overall product quality. • Acquire a deep understanding of the domain and approach testing holistically, ensuring comprehensive coverage. • Have a critical mindset to discern what to automate and what not to, strategically sampling critical tests focusing on balancing risk, cost, and value. • Coach developers and other SDETs.
Lead Software Engineer in Test
CoStar GroupThe CoStar Group is in the business of equipping clients with tools for success. The company creates opportunity by combining its deep understanding of more tha
Title: Matterport - Lead Software Engineer in Test Location: Sunnyvale, CA US Full time job requisition id: R38339 Job Description: CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed, and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. About Matterport: Matterport is leading the digital transformation of the built world. Our groundbreaking spatial computing platform turns buildings into data making every space more valuable and accessible. Millions of buildings in more than 170 countries have been transformed into immersive Matterport digital twins to improve every part of the building lifecycle from planning, construction, and operations to documentation, appraisal, and marketing. About the Role: We’re looking for a Lead Software Engineer in Test to join our Quality team and lead the development of manual and automated test cases for our web applications. We are seeking someone who is passionate about software quality and takes an automation-first approach, complemented by strong exploratory manual testing skills. The ideal candidate is a self-starter who thrives in dynamic environments, takes full ownership of their work, and is driven to deliver high-quality products. This position is located in Sunnyvale, CA and offers a schedule of Monday to Thursday in office and the option to work from home on Friday. Responsibilities: - Understand product requirements and contribute to product design discussions - Define test strategies and develop detailed test plans - Design and implement robust test automation frameworks and tools - Increase automation coverage for key features and workflows - Drive proof-of-concept initiatives and build internal testing utilities - Perform end-to-end testing with a strong customer-focused mindset Basic Qualifications: - Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, or comparable major from an accredited, not for profit college or university. - 8+ years of experience developing testing solutions for enterprise applications - Hands-on experience with OOP programming languages such as Java, Kotlin or JavaScript - Experience with test automation frameworks such as Mocha, Chai, Selenium, Cypress, or WebdriverIO - Experience with GraphQL or REST API’s - Ability to apply engineering best practices to address test automation challenges - Track record of commitment to prior employers Preferred Qualifications and Skills: - Proficient in writing clean, maintainable, and well-documented code - Strong understanding of user workflows and customer use cases to ensure product quality - Knowledge of software testing methodologies - Experience working within Agile development environments and understanding of the full Software Development Lifecycle (SDLC) - Eagerness to learn new technologies and develop proof-of-concepts for testing initiatives - Experience working in a 3D development environment What’s in it for you? When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed. We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, and tuition reimbursement. Our benefits package includes (but is not limited to): - Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug - Life, legal, and supplementary insurance - Virtual and in person mental health counseling services for individuals and family - Commuter and parking benefits - 401(K) retirement plan with matching contributions - Employee stock purchase plan - Paid time off - Tuition reimbursement - On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes - Access to CoStar Group’s Diversity, Equity, & Inclusion Employee Resource Groups - Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks This position offers an annual salary range from $125,000-$227,000 determined by relevant skills and experience, in addition to a generous benefits plan. We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position. #LI-CG1 #Matterport CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing
• Provide hands-on expertise for test automation architecture, strategy, script design and execution, automation framework, virtualization, etc. • Deliver technical leadership to the enterprise-grade company to drive core software quality assurance best practices for tools, automation, test data and more • Collaborate with all levels of leadership to develop, build, and maintain automation frameworks, tools, and test strategies • Work with delivery teams to build out solutions on testing and automation to achieve CI/CD • Evaluate the current automation and testing implementations and perform a gap analysis to provide strategic technical direction • Lead and mentor a growing team of software quality assurance engineers
• Work closely with software engineers to build quality by ensuring proper test and conditional coverage, configuration quality, logging and monitoring. • Develop and implement QA standards, processes, tools and methodologies; Partner with other functions to establish testing requirements for microservices with principles of 12 factor applications adherence. • Document functional/integration test strategies and test plans; translate complex system requirements and specs into test requirements and testing methods. • Participate in feature/story elaboration, Identify and implements complex automation efforts.




