• Design and build simulation scenarios representing nominal, edge-case, and adversarial conditions. • Translate autonomy requirements and real-world incidents into reproducible tests with clear, measurable outcomes. • Script environments, actors, triggers, and behaviors in Isaac Sim or Unreal Engine. • Maintain configuration-driven scenario setups (YAML/JSON) for reproducibility, sweeps, and domain randomization. • Develop Python utilities and Bash scripts to automate scenario generation, execution, and evaluation. • Integrate simulation-based tests into GitHub-based CI pipelines (PR checks, nightlies, release validation). • Improve reliability, scalability, and visibility of scenario execution, including logging and metric collection. • Implement and refine system-level KPIs (safety constraints, planner success, tracking stability, interactions). • Analyze simulation results to detect regressions, understand multi-module behaviors, and surface meaningful insights. • Support ML dataset creation from simulation and resimulation, including metadata curation and edge-case identification. • Work closely with autonomy, controls, QA, and release engineering to align scenarios with feature changes and test requirements. • Participate in debugging sessions, test planning, and design reviews to identify issues and propose improvements. • Document scenarios, evaluation logic, and test plans clearly for internal stakeholders. • Take increasing ownership of scenario domains, test frameworks, or automation pipelines. • Influence simulation test strategy and standards through strong technical judgment. • Help mentor teammates, improve processes, and drive best practices around system-level testing.

• Scoping out comprehensive test plans based on design requirements and code changes. • Executing tests on a large-scale distributed test network. • Verifying the server using white-box/black-box/functional/stress testing techniques. • Investigating and analysing root causes of technical issues / performance bottlenecks. • Setting up test bed environment for regression testing /performance testing. • Maintaining/enhancing/developing test tools and automation frameworks.

• Responsible for improving the automated and manual testing infrastructure at Alpaca - helping our developers quickly and reliably deliver new features. • Develop a comprehensive testing strategy for our API surface. • Improve developer experience by standardizing tooling and infrastructure. • Coordinate with other teams to improve test coverage, reliability and speed. • Mentor and guide product engineers, fostering a culture of quality and continuous improvement within the team. • Design and execute load, stress, and scalability tests to ensure our platform can handle growing user demands.

• Design, develop, and enhance robust automation frameworks using modern tools (e.g., Playwright, Cypress, Selenium). • Write clean, maintainable automated test suites for web, API services, and other application types. • Integrate automated tests into Git-based CI/CD pipelines (e.g., GitHub Actions, Jenkins) to support continuous delivery. • Execute and manage functional, regression, integration, and specialized performance tests. • Participate in requirement reviews to define test scenarios, identify edge cases, and ensure maximum test coverage. • Perform root cause analysis of failures and collaborate directly with development and product teams to resolve defects and ensure quality metrics are met. • Maintain test data, mocks, and environments, and build specialized tooling (e.g., monitoring/reporting dashboards) to improve QA efficiency. • Document test plans, test cases, automation design decisions, and contribute to the continuous improvement of overall QA processes and best practices.