Job Closed
This listing is no longer active.
Meet Your Future Workforce.
Staff AI Software Developer in Test
Location
Europe
Posted
75 days ago
Salary
0
Seniority
Lead
Job Description
Staff AI Software Developer in Test
Wand AI
• Design and implement QA foundations and evaluation frameworks for assessing AI agents, their workflows and processes. • Design and run experiments to assess AI-driven QA processes, including prompt strategies, automation workflows, and agent performance. • Benchmark systems across multiple engineering streams to determine accuracy, reliability, cost, and consistency of outputs. • Develop approaches for creating synthetic datasets and structured test data to support reliable evaluation. • Identify gaps in existing testing approaches and design AI-based solutions or agents to address them. • Build proof-of-concepts (POCs) to explore new testing approaches and validate ideas. • Structure and document product knowledge, including user journeys, APIs, and business rules, to support AI-assisted testing systems. • Evaluate the cost, ROI, and effectiveness of different QA approaches and automation strategies. • Collaborate closely with the QA Lead and engineering teams to integrate AI-assisted QA into development workflows. • Ensure AI-driven testing processes produce consistent, reliable, and high-quality results. • Remain hands-on in building tooling, experiments, and testing infrastructure.
Job Requirements
- Strong background in SDET, test automation.
- Experience building and maintaining automated testing frameworks and QA tooling.
- Hands-on experience building proof-of-concepts or experimental systems.
- Experience evaluating or working with AI systems, LLMs, or agent-based workflows.
- Ability to design structured experiments and evaluation methodologies.
- Strong understanding of testing fundamentals, including UI and API automation tools such as Cypress, Playwright, or similar.
- Experience analysing systems and identifying opportunities to improve processes through automation or AI.
- Ability to work hands-on while also contributing to process design and strategic improvements.
- Preferred Experience:
- Experience working in AI-focused companies or startups.
- Hands-on experience building or experimenting with AI agents or AI-driven automation workflows in Quality Assurance.
- Experience designing evaluation frameworks for AI systems.
- Experience working with synthetic data generation or test data modelling.
- Familiarity with knowledge graph systems or structured product knowledge mapping.
- Experience evaluating cost efficiency and ROI of engineering or QA initiatives.
- Experience working in fast-moving startup environments.
Benefits
- None specified in the job posting
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Full-stack Software Engineer, Retention
Relay CommerceWe help merchants attract, convert, and retain customers. $1BN+ of incremental GMV generated for merchants.
• Work as part of a skilled, multi-disciplined product engineering team to deliver modern software. • Deliver TypeScript services built on Docker, Node, Express, PostgreSQL, and TypeORM. • Contribute to React applications which rely on our APIs and integrate with Shopify. • Deliver features that address real customer problems with your team. • Support Customer Success by maintaining the live production system. • Participate in architectural discussions and contribute to process improvements.
• Spearhead the design and deployment of a next-generation, network device automation infrastructure. • Lead a team in building a platform that automates everything from Pull Request to Regression Validation on physical test beds using high-performance IXIA traffic generators. • Build and deploy AI/LLM-based agents to parse complex log files and SPyTest results. • Develop agents capable of test bed failure recovery and leverage AI to analyze long-term software quality trends.
Senior Staff Engineer
Control RisksThe global specialist risk consultancy - Helping organisations succeed in a volatile world
• Lead the design, implementation, and optimization of Zscaler solutions (ZIA, ZPA) across a complex enterprise environment. • Act as a technical SME for secure network architecture, including zero trust principles and secure access transformation. • Partner with infrastructure, security, and application teams to ensure seamless integration of Zscaler into existing systems and workflows. • Provide hands-on support during rollout, including configuration, troubleshooting, and performance tuning. • Advise engineering teams on secure coding practices, with a focus on risks introduced by AI-assisted development tools (e.g., code generation, copilots). • Conduct and support AI-driven code reviews, identifying vulnerabilities, insecure patterns, and data exposure risks. • Develop security guardrails, standards, and best practices for AI-enabled software development. • Translate security and technical concepts into clear guidance for both technical and non-technical stakeholders. • Support compliance and risk mitigation efforts related to application security and enterprise security controls.
Software Engineer – Full Stack
DrimoAcercar el futuro es creer que nada es imposible. Convierte ideas en tecnología.
• Arquitectura de software: Comprender y razonar sobre decisiones arquitectónicas, evaluando sus implicancias en términos de performance, escalabilidad, mantenibilidad, etc. • Diseño e implementación de API REST: Desarrollo de APIs REST aplicando buenas prácticas de diseño y arquitectura de software, incluyendo el manejo de errores, validaciones y patrones comunes. • Integración con APIs y servicios Cloud: Conexión e integración entre distintos servicios, tanto internos como de terceros, ya sea desde el frontend o entre microservicios backend. • Manejo de bases de datos: Interacción fluida con bases de datos SQL, incluyendo consultas y operaciones CRUD en herramientas como PostgreSQL o BigQuery.
