Software Mind logo
Software Mind

Software House focused on results since 1999

Senior QA Automation Engineer

QA Automation EngineerQA Automation EngineerFull TimeRemoteSeniorTeam 1,001-5,000Since 1999H1B No SponsorCompany SiteLinkedIn

Location

Latin America (LATAM)

Posted

7 days ago

Salary

0

Seniority

Senior

No structured requirement data.

Job Description

Senior QA Automation Engineer

Software Mind

Role Description Software Mind is building a private, tenant-isolated AI assistant for the real estate title and settlement industry. The platform is a retrieval-first (RAG) system that ingests historical email, documents, and structured metadata into a per-tenant vector index, and serves grounded, cited, expert-weighted answers through a chat-style Q&A interface with single sign-on and full audit logging. The platform is AWS-native with a Python/FastAPI backend, Vue.js frontend, OpenSearch/Pinecone vector store, and OpenAI/Anthropic/Bedrock as LLM provider. You will join a senior, cross-functional LATAM-based team where hands-on AI delivery experience, not just familiarity, is the baseline expectation. You build the validation harness that determines whether the AI system meets accuracy standards; this is your primary deliverable. This is not generic test automation. You need to understand what 'correct' means for a RAG-based retrieval system and design test frameworks that can surface retrieval failures, hallucinated citations, confidence score drift, and RBAC access violations. Responsibilities - Design and implement the validation harness for RAG output quality: retrieval accuracy, citation correctness, and grounding - Build automated test suites for the AI Extraction Gateway across Simple RAG and Complex RAG implementations - Develop and execute accuracy rubric test cases in collaboration with the BA and Designated Subject Matter Expert - Automate regression testing for confidence score calibration and source weighting behaviour - Test RBAC enforcement and role-specific filtered view access controls - Validate audit logging completeness and document lifecycle traceability - Build and maintain the incremental ingestion pipeline test suite - Contribute to go/no-go decision packs: produce accuracy reports and test evidence documentation Qualifications - +90% English written and oral (at least B2 level) with excellent communication skills - 6+ years in QA automation engineering; senior seniority required - Strong test automation engineering skills; Python preferred (pytest or equivalent framework) - Experience with API testing and contract testing - Comfortable designing test frameworks for non-deterministic or probabilistic systems - Experience in agile/scrum environments with Jira-based test management Requirements - Prior experience testing RAG systems, LLM outputs, or semantic search relevance; this is a strong differentiator - Familiarity with AI evaluation frameworks: RAGAS, TruLens, or custom rubric-based evaluation approaches - Background in compliance-sensitive testing: audit trail validation, access control verification, or regulated-data environments Benefits - We are accepting applications from LATAM countries

Related Categories

Related Job Pages

More QA Automation Engineer Jobs

Network Automation Engineer (Python + Network APIs)

Bright Vision Technologies

Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. We recognize that our people are our strength. We are an equal opportunity employer and place a high value on diversity and inclusion. We do not discriminate on the basis of any protected attribute. We make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans.

Role Description We are seeking a Network Automation Engineer who blends strong Python development skills with deep networking domain expertise to automate network configuration, change management, and observability across multi-vendor enterprise networks. The role focuses on building production-grade automation using modern network APIs, infrastructure-as-code, and CI/CD practices that bring software engineering discipline to network operations. The ideal candidate writes idiomatic Python, has shipped network automation in production, and combines networking depth with practical software-engineering rigor. In this role you will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production. Key Responsibilities - Design and develop network automation solutions in Python using Netmiko, Nornir, NAPALM, and Scrapli. - Build automation pipelines for configuration management, deployment, and validation across multi-vendor environments. - Develop integrations with network APIs including NETCONF, RESTCONF, gNMI, and vendor-specific APIs. - Implement source-of-truth platforms such as NetBox or Nautobot and drive automation from authoritative data. - Build infrastructure-as-code for network configuration using Ansible, Terraform, and Jinja2 templating. - Implement network testing and validation using pyATS, Genie, Batfish, and Suzieq. - Develop CI/CD pipelines for network changes including pre-deployment validation and rollback. - Build observability and telemetry pipelines using gNMI, streaming telemetry, and modern analytics platforms. - Implement intent-based networking patterns and self-healing network workflows. - Automate compliance and audit workflows across the network estate. - Partner with network engineering teams to identify and automate high-impact manual workflows. - Develop reusable libraries, frameworks, and abstractions adopted across multiple automation efforts. - Mentor network engineers on Python development, software engineering practices, and modern automation patterns. - Stay current with network automation tooling, vendor API evolution, and broader industry developments. Qualifications - Bachelor’s degree in Computer Science, Networking, or a related field. - Five or more years of network automation experience. - Strong Python development skills including OOP, testing, and packaging. - Deep networking fundamentals including routing, switching, and BGP. - Hands-on experience with Netmiko, NAPALM, Nornir, or Scrapli. - Experience with modern network APIs (NETCONF, RESTCONF, gNMI). - Strong experience with Ansible and Jinja2 templating for network automation. - Familiarity with NetBox, Nautobot, or other source-of-truth platforms. - Strong Git-based workflows and CI/CD experience. - Excellent communication and collaboration skills. Preferred Qualifications - Cisco DevNet or vendor automation certifications. - Experience with multi-vendor networks (Cisco, Arista, Juniper). - Familiarity with streaming telemetry and modern observability stacks. - Open-source contributions to network automation projects. - Experience with cloud networking automation in addition to on-premises. How to Apply For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com .

United States
$100K - $150K / year
Job Closed
VetsEZ logo

Test Automation Engineer

VetsEZ

Agile | Adaptive | Ardent

Full TimeRemoteTeam 201-500H1B No Sponsor

Test Automation Engineer (Remote Opportunity) - Austin, TX - Full-Time VetsEZ is seeking a mid-level Test Automation Engineer. This product line manages various software products, middleware platforms, system integrations, health data integrations, and Electronic Health Records (EHR) integrations. The candidate must reside within the continental US. Responsibilities: - Working with software developers, analysts and functional testers to develop automated tests - Developing end-to-end test automation solutions with business customers and software developers, documenting issues and working with peers to troubleshoot issues - Collaborate with other QA leads and Test Engineers in helping define, evolve and promote enterprise test strategy - Design and execute tests against user stories covering all aspects of functional and non-functional test requirements - Perform data validations using complex SQL statements and other tools (e.g. Query Analyzer, Redgate, etc.) - Create scalable test solutions through the identification, implementation and maintenance of test automation frameworks suitable for middleware, API and Data layers - Plan and execute suitable regression testing activities related to the change/release scope - Provide testing estimates and meet project testing timelines - Collaborate with delivery team and/or business partners in troubleshooting root cause of software issues - Look for opportunities to improve test execution and delivery - Stay current on tech trends and take on additional responsibilities as needed to support project success. Requirements: - Bachelor’s in Computer Science, Electronics Engineering, or related technical discipline; minimum 10 years of experience. - Skilled in manual and automated testing, including middleware (Java, Node.js, AWS) with Selenium, TestNG, and Java scripting - Proficient in JIRA for test and defect management; familiar with Rally and artifacts repository tools. - Knowledge of Section 508 tools (Andi, JAWS reader) and AWS services (Step Functions, State Machines, Canary, CloudWatch Logs, Lambda). - Expertise in designing test automation frameworks for APIs and data layers; experienced with ReadyAPI/SoapUI, Groovy, CI/CD pipeline automation, and performance, regression, and integration testing. - Strong communication, problem-solving, and teamwork skills; adept at collaborating with developers in Agile environments. Additional Qualifications: - Experience working with Department of Veterans Affairs (VA) or other health-related organizations desired - Ability to work effectively in a multi-stakeholder, Agile, and DevSecOps environment - Ability to obtain a government clearance Benefits: - Medical/Dental/Vision - 401k with Employer Match  - PTO + Federal Holidays   - Corporate Laptop  - Training opportunities - Remote Opportunity

United States
Full TimeRemoteTeam 51-200Since 2010H1B No Sponsor

Role Description We are currently seeking a Quality Assurance Engineer (m/f/d) for our client in the Lucerne area. In this role, you will be responsible for the development, implementation, and verification of Quality Assurance requirements and act as the main interface between Process Engineering and Operations for all quality and safety topics. You will ensure the successful execution of the Quality Program and compliance with Product Assurance requirements at the manufacturing site. - Develop and promote Quality Assurance requirements and a strong quality culture - Ensure robust quality processes and cost-efficient program execution in collaboration with Engineering, Operations, and Supply Chain - Act as main interface for Process Engineering and Operations on quality and safety topics - Define and implement Critical-to-Quality (CTQ) characteristics and control plans - Lead non-conformance management, root cause analyses (RCA), and failure investigations - Moderate and lead Process FMEA activities - Supervise Manufacturing, Assembly, Integration and Testing (MAIT) quality aspects - Define and monitor Measuring & Test Equipment (M&TE), Measurement System Analysis (MSA), and process capability - Perform quality inspections and manage KIP/MIP documentation - Establish and maintain process quality documentation and support process qualification - Ensure compliance with customer, regulatory, and internal requirements - Contribute to proposals (RFI/RFQ), audits, and quality organization development (training & coaching) - Support product and qualification data packages, especially for space applications Qualifications - Degree (BSc/MSc) in Engineering or a related field - Relevant experience in Quality Assurance and Continuous Improvement - Knowledge of standards such as EN9100, ECSS, NASA, and MIL - Strong technical understanding and ability to analyze complex systems - Hands-on mindset combined with solid theoretical knowledge - Experience with quality tools and methodologies (e.g., 5Why, Ishikawa/Fishbone, FMEA) - Proficiency in MS Office - Experience in the space industry is an advantage - Strong analytical, critical thinking, and interpersonal skills - Independent and team-oriented working style - Proactive, communicative, and confident personality - Passion for quality and continuous improvement - Willingness to travel (approx. 5–10%) - Excellent communication skills in English (written and spoken) - Additional languages (German, French, or Swedish) are a plus Company Description Die Coopers Group AG ist eine agile Schweizer Recruiting Agentur, die Spezialisten und Führungskräfte in den Bereichen IT, Life Sciences, Engineering und Finance vermittelt. Mit flexiblen Ansätzen bringen wir Kandidat:innen und Unternehmen zusammen, die nicht nur fachlich, sondern auch menschlich zusammenpassen.

Switzerland
Job Closed
Ad Hoc LLC logo

DevSecOps Engineer – Automation

Ad Hoc LLC

Digital-first government for the common good.

Full TimeRemoteTeam 501-1,000Since 2014H1B No Sponsor

• The DevSecOps & Automation Engineer supports the design, automation, deployment, and optimization of secure, scalable, and compliant systems across VA programs. • This role enables continuous delivery, infrastructure modernization, and operational excellence for mission-critical applications supporting Veterans. • The engineer ensures alignment with VA OIT architecture, TRM-approved technologies, federal cybersecurity standards, and ATO requirements.

North America
$125K - $140K / year