Job Closed
This listing is no longer active.
Software Development Partner. Result-driven. Quality-obsessed.
Intermediate/Senior Test Engineer Automation
Location
Brazil
Posted
111 days ago
Salary
0
Seniority
Senior
Job Description
Intermediate/Senior Test Engineer Automation
Dev.Pro
• Design, develop, and maintain automation frameworks and test strategies for AI products • Evaluate and improve RAG flows, ensuring accuracy and performance • Test LLM integrations with prompt validation, hallucination checks, and response consistency checks • Prepare test data and clarify testing requirements as needed • Create and run automated test suites for APIs, data pipelines, and model integrations • Integrate automated tests into CI/CD pipelines to maintain quality and stability • Analyze test results, report defects, and work with teams to resolve issues • Participate in code reviews, sprint ceremonies, and QA planning sessions • Maintain clear test documentation and provide regular updates to stakeholders • Continuously improve testing tools, processes, and automation efficiency
Job Requirements
- 3+ years of experience in automation testing
- Strong programming skills in Python
- Practical experience with pytest or similar Python testing frameworks
- Experience developing and maintaining test automation frameworks
- Solid understanding of test design, strategy, and QA best practices
- Hands-on experience with CI/CD pipelines and tools (Jenkins, GitLab CI)
- Understanding of RAG pipelines and testing AI/ML-based systems
- Familiarity with AI safety testing (prompt validation, hallucination checks, response consistency)
- Familiarity with API (REST, HTTP) testing and data validation
- Good knowledge of Git, test reporting, and bug tracking tools
- Strong analytical and problem-solving skills
- Upper-Intermediate English level
- Desirable:
- Experience with major cloud platforms (GCP, AWS, Azure)
- Knowledge of containerization tools (Docker, Kubernetes)
Benefits
- Get 30 paid days off per year to use however you like — vacations, holidays, or personal time
- 5 paid sick days, up to 60 days of medical leave, and up to 6 paid days off per year for major family events like weddings, funerals, or the birth of a child
- Partially covered health insurance after the probation, plus a wellness bonus for gym memberships, sports nutrition, and similar needs after 6 months
- Join English lessons and Dev.Pro University programs, and take part in fun online activities and team-building events
Related Guides
Related Categories
Related Job Pages
More SDET Jobs
• Review technical specifications and create test strategies. • Propose improvements in testing systems and processes to improve quality and efficiency. • Conduct user acceptance, exploratory, regression, and end-to-end testing. • Develop automated functional and performance tests from scratch. • Perform manual testing of new features and bug fixes. • Identify, triage, and troubleshoot issues across distributed systems (e.g., microservices, event-driven architectures). • Own end-to-end testing of integrated proprietary and third-party services. • Recommend design changes to increase testability. • Collaborate with stakeholders to assess severity, prioritize, and track issue resolution. • Guide engineering teams on testing best practices and coordinate coverage across unit, integration, and contract testing. • Define and execute performance testing (load, stress, etc.). • Prepare and maintain QA documentation (test plans, test cases, test metrics, issue logs). • Reconcile data across key systems to ensure consistency.
Test Automation Engineer
Protiviti IncProtiviti is a global consulting firm that helps businesses solve critical challenges in finance, technology, operations, data, and governance. Established in 2
• Participate in Sprint ceremonies • Performing functional testing • Utilizing automation frameworks and tools to develop test automation to support production releases and updates • Work collaboratively in small and nimble Sprint teams
Lead Software Development Engineer in Test (SDET), QA Manager
DrivetrainStrategic finance platform for the modern business
• Establish and deliver the quality strategy for a product based on the ideal blend of automation and manual testing • Manage, recruit and lead a quality team consisting of SDETs, Test Analysts and TA lead • Accountable for the quality of all deliverables, workflows and relationships for the quality team • Work closely with development technical directors and program managers to align on the quality strategy • Forecast and manage the product's test schedules, dependencies and resources • Champion and influence software development best practices and the customer experience • Drive identification, design and delivery for technical solutions (frameworks, tests, API hooks, tools) increasing test effectiveness and coverage, while reducing the cost of test execution • Implement metrics, analyze test data and results to identify patterns, report on risk status to development partners, and influence software quality • Share insights, solutions, and best practices within the team and across Drivetrain
• Design and develop automation testing frameworks for software applications, in the field of enterprise content management and e-government • Create test plans • Develop automated tests using Selenium and Java • Analyze, design, and construct test data for automated testing of software developments • Learn new automation tools and scripting languages • Evaluate emerging technologies.



