Job Closed
This listing is no longer active.
Industry-leading OSINT solutions.
Senior QA Engineer – AI-Native Platform
Location
Kazakhstan
Posted
100 days ago
Salary
0
Seniority
Senior
Job Description
Senior QA Engineer – AI-Native Platform
Social Links
• Build and maintain AI evaluation framework • Test RAG pipeline quality and retrieval relevance • Design testing approaches for non-deterministic LLM outputs • Build multi-tenant isolation test suite, including AI layer isolation • Write cross-service integration and contract tests • Test Temporal workflows, event-driven flows, and YAML DSL validation • Build and maintain automated regression suites
Job Requirements
- 3+ years in QA automation / SDET
- Hands-on experience testing AI/ML systems
- Strong Python (pytest, async testing)
- Experience building test infrastructure from scratch
- Experience testing distributed or event-driven systems
- Experience testing multi-tenant applications
- Autonomous work style
- English – B1 level or higher
- RAG / vector search quality evaluation (Nice To Haves)
- LangGraph, LangChain, or similar agent frameworks (Nice To Haves)
- Go test automation (Nice To Haves)
- BentoML / MLflow or equivalent MLOps tooling (Nice To Haves)
- Security testing: prompt injection, context leakage (Nice To Haves)
- Performance / load testing for ML inference endpoints (Nice To Haves)
- Data pipeline testing (Delta Lake, Great Expectations, Dagster) (Nice To Haves)
- Russian – advanced level or higher (Nice To Haves)
Benefits
- Remote-first setup: work from anywhere in the world (except Russia and Belarus)
- Work on a greenfield, technically challenging product (distributed system at scale)
- Direct collaboration with senior technical stakeholders (engineering leadership, product)
- Ownership and impact: influence QA strategy, tooling, and quality gates from the early stage of the product
- Fast iteration environment: work closely with engineering to improve reliability and release confidence
Related Guides
Related Categories
Related Job Pages
More QA Engineer Jobs
Senior Quality Engineer
Creyos (formerly Cambridge Brain Sciences)A simple & scientifically-validated digital platform for assessing cognitive function.
About Us Circle is building the world’s leading all-in-one platform for online communities. We make it possible for creators, coaches, educators, and businesses to bring together their audience with engaging discussions, live streams, events, chat, courses, and payments — all in one place, all under their own brand. We’re proud to be a fully remote company of around 200 (and growing!) team members from 30+ countries around the world. We seek exceptional individuals around the world, set them up to do the best work of their lives, and in turn, create a meaningful impact in their own lives. We don't track hours, but we do manage for high expectations very closely. We collaborate across time zones, are highly async, and like to document a lot. Twice a year, we bring the whole company together in beautiful places around the world for our company offsites. So far, we’ve hosted offsites in Turkey, Portugal, Mexico, Thailand, Colombia, Italy, Ireland, and more, with still more to come! Check out our Careers page for more about working at Circle. About the role We’re looking for a Senior Quality Engineer to join Circle, where you’ll be part of an agile Quality Engineering team that plays a key role in supporting our all of our engineering teams. From the design phase to product release, you’ll be driving quality practices and ensuring that we deliver the best possible product. As someone with strong technical judgment, you will play a pivotal role in fostering a “shift-left” approach to quality, helping to implement high standards and best practices while staying nimble in a fast-paced environment. What you'll be doing Collaborating with cross-functional teams (design, product, engineering) from the start of projects to ensure quality is integrated throughout the process. Leading quality initiatives and driving test automation practices to ensure robust and scalable solutions. Developing and maintaining automated tests across web and mobile using tools likes Playwright, Appium, and WebdriverIO with JavaScript/TypeScript. Working with existing data factories and API’s to utilize data points to create new tests. Creating new architectural functionality to support automated test creation (example: Stripe, Buy Now Pay Later, ApplePay/GPay, etc.) Implementing CI changes and debugging failing tests Identifying and driving improvements to our quality processes, tools, and frameworks. Participating in code reviews and sharing your expertise to improve team practices around testing and quality. Help in driving standards and best practices around test automation, quality, and development processes. Continuously evaluating and exploring innovative testing approaches, including AI-powered testing strategies. Taking ownership of end-to-end test strategies, from design to execution, in a constantly evolving environment. Take project requirements and quickly turn those into test cases for traceability of system requirements and aid with test automation. Autonomy and trust to do your job: we care about outcomes over everything else. Paid time away: all employees are given 35 days of PTO annually. We also offer a paid sabbatical after 5 years. Generous U.S. benchmarked compensation and startup equity no matter where you are in the world.* Awesome medical coverage with 100% coverage for you and your family, or medical reimbursement options where applicable!* Parental leave for parents expanding their family, or just starting one. Home office stipend to help you get up and running. Learning & development stipend to help you level up your professional skills. Annual bonus potential for roles that don't already receive variable income or commission. Company retreats: Twice a year, the Circle team gets together for a fully paid company retreat in incredible places around the world! We’ve had past retreats in Colombia, Portugal, and Mexico, with more planned on the horizon. Check out our Careers page for more. * Your role, location and unique circumstance may affect this. Candidate Safety & Interview Process Notice At Circle, the safety and trust of our candidates is extremely important to us. Unfortunately, recruiting fraud is increasingly common in the job market, and bad actors sometimes impersonate companies or employees. To help protect you, here’s what you can expect from our hiring process: How Our Process Works All applications are submitted through our official applicant tracking system (Greenhouse). If selected to move forward, you may be invited to record a short introductory video, or directly into a live interview. All live interviews are conducted face-to-face over video (Zoom or Google Meet) with a member of the Circle team. We do not conduct text-only interviews. We do not conduct interviews via chat apps or messaging platforms. We do not use AI bots to interview candidates. Official Communication Channels All official communication from Circle will come from no-reply@circle.co, or an email address ending in @circle.co or @circle.so. We will never contact you from unofficial domains (such as “.team”, “.careers”, or similar variations). We will never request sensitive personal information early in the process, or ask for payment of any kind. If you receive a suspicious message claiming to be from Circle, please do not respond. We appreciate your vigilance, and look forward to connecting with you through our official channels. Diversity, Equity & Inclusion As a fully-remote international company, diversity is baked into our DNA. Here’s how our CEO, Sid Yadav, frames our hiring mission: “let’s find talent in underserved and under-represented corners of the world, set them up to do the best work of their lives, and in turn, change their life.” To achieve this hiring mission, we offer competitive U.S. benchmarked compensation no matter where someone’s located in the world, and we proactively seek candidates who expand representation of backgrounds, cultures and lived experiences in our teams. Equal Employment Opportunity Circle is an equal opportunity employer and as such, we do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other characteristic protected by applicable laws. If you require any accommodations during the recruitment process, please let us know and we will work with you to meet your needs. How We Use Candidate Data At Circle, we are committed to protecting your personal information. As a job applicant, the personal data you provide to us is collected and processed in accordance with the General Data Protection Regulation (GDPR) in the EU and the California Consumer Privacy Act (CCPA) . This notice outlines the types of personal information we collect, the purpose for collecting it, and your rights. Information We Collect: We collect the following categories of personal information from job applicants: Contact information (such as name, email address, phone number) Employment history and qualifications Education history References and any other information you choose to share with us during the application process Purpose of Collection: We collect this information for the following purposes: To assess your qualifications and suitability for the position To communicate with you during the recruitment process To comply with legal and regulatory obligations Your Rights Under GDPR and CCPA: You have the following rights regarding your personal information: The right to request access to the personal information we hold about you. The right to request the deletion of your personal information, subject to certain legal exceptions. The right to opt out of the sale of your personal information (Note: We do not sell personal information). For more information about how we handle your personal data or to exercise your rights, please refer to our full Privacy Policy. By submitting your application, you acknowledge that you have read and understood this privacy notice.
Doximity is transforming the healthcare industry. Join our mission to help every physician be more productive and provide better care for their patients. As medicine's largest network in the United States, there's an elevated level of responsibility in everything we do. We don't take that responsibility lightly and are committed to building diverse teams with an inclusive culture that can make a direct impact on the healthcare system. One of Doximity's core values is stretching ourselves. Even if you don't check off all the boxes below we encourage you to apply. Doximity is full of exceptional people who bring their own unique experiences to work everyday and make us all better for it! This position is for a senior Mobile QA Engineer with a passion for testing, reporting, and improving QA processes to join our 11-person Mobile QA team. We’re looking for a candidate who is analytical, enjoys thinking outside the box, and loves to solve complex problems in a fast-paced agile environment. This role can be filled in our San Francisco headquarters OR remotely in the U.S. How you’ll make an impact Perform thorough black-box testing of our native mobile (iOS & Android) and web applications to validate functionality, usability, and cross-platform consistency. Create, update, and execute comprehensive test cases and test plans to ensure that our software meets functional and business requirements. Compensation The US total compensation range for this full-time position is $128,000 - $171,000 (inclusive of salary + equity). Our ranges are determined by role and level. The range displayed on each job posting reflects the approximate total target compensation for the position across the US. Within the range, individual pay is determined by factors including relevant skills, experience, and education/training. Please note that the compensation listed does not include benefits. More on Benefits/Perks Doximity is proud to offer industry-leading benefits to our full time employees. Some of our offerings include: Medical, dental, vision offerings for you and your family 401k with matching program Family building support, Childcare FSA, and parental leave Life, AD&D, and Disability Generous time off, holidays and paid company trips Wellness benefits…plus many more! More About Doximity… For the past decade, it’s been our mission to help every physician be more productive so they can provide better care for their patients. We believe that when doctors are connected, the healthcare system works better and patients benefit. Doximity enables our verified clinician members to collaborate with colleagues, stay up-to-date with the latest medical news and research, manage their careers, and conduct virtual patient visits. Today, Doximity is the leading digital platform for U.S. medical professionals, with over 80% of physicians, 50% of all nurse practitioners and physician assistants, and 90% of graduating medical students as members. Joining Doximity means being part of an incredibly talented and humble team passionate about improving inefficiencies in our $4.3 trillion U.S. healthcare system. We are a team of doers who solve problems everyday by treating obstacles like an adventure, and we love creating technology that has a real, meaningful impact on people’s lives. Doxers are committed to working towards a more equitable world both within and beyond our office walls. This starts by fostering an inclusive and diverse work environment where differences are valued and all employees are encouraged to bring their full, authentic selves to work daily. To learn more about our team, culture, and users, check out our careers page, company blog, and engineering blog. We’re growing fast, and there’s plenty of opportunity for you to make an impact—join us! For more information, visit Doximity.com. ____________________________________________ EEOC Statement Doximity is proud to be an equal opportunity employer, and committed to providing employment opportunities regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, pregnancy, childbirth and breastfeeding, age, sexual orientation, military or veteran status, or any other protected classification. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
• Collaborate with Merchandising, Sourcing, and Product Development teams to proactively identify and address potential quality concerns during product development and production. • Ensure products meet design intent, safety standards, construction requirements, and regulatory compliance for both domestic and international markets. • Conduct and support Failure Mode and Effects Analysis (FMEA) for new product development initiatives. • Develop and implement product testing protocols and inspection plans to mitigate potential quality or defect issues, including defining test methods, pass/fail criteria, and sample sizes. • Execute and oversee testing and inspection plans to ensure adherence to approved standards. • Maintain governance of Test Protocols and Inspection Plans, ensuring all internal teams and third-party partners follow approved documentation and processes. • Stay current on applicable regulations and industry best practices and implement necessary updates to ensure compliance. • Build strong working relationships with internal and external partners to ensure quality standards and systems are consistently applied. • Lead and develop a team of Quality Assurance professionals supporting quality and compliance programs. • Drive defect reduction and continuous improvement initiatives across suppliers and production partners.
Note: This is a short-term project (~2 months) with possibility to extend. Ideal candidates will be located within commuting distance to the New York City area but remote candidates may also be considered.About Us: Advanced Systems Group, LLC enables creativity through better technology and operations for media creatives and content owners. From acquisition to delivery, on-premises or in the cloud, ASG ensures our clients’ success through tailored solutions. One of North America’s largest Media and Entertainment Technology and Operations suppliers, we provide engineering services, physical and cloud integration, training, support, and managed services. Our Managed Services deliver customized operations and services for all phases of media production, including creative and engineering. Founded in 1997, and providing nationwide services, ASG has teams based in North America, South America, and Europe. We are looking for: Advanced Systems Group LLC. is seeking an experienced Production Resource Coordinator supports the smooth and efficient running of the Resource Operations organization within Managed Services. This role combines core production scheduling responsibilities with specialized onboarding coordination for key clients. The aim is to ensure that Flex talent, Managed Services hires and production teams are deployed accurately, onboarded successfully and supported through clear, dependable processes. This position partners closely with Regional Managers, Account Management, Tech Ops, and our client teams to deliver a reliable, white-glove operational experience. Responsibilities: Production Scheduling and Resource Deployment: - Coordinate scheduling, assignment and deployment of Flex production personnel across studio, live event and remote productions. - Act as the primary point of contact for client scheduling requests, capturing requirements, confirming details and ensuring accurate resource allocation. - Manage engagement calendars using Monday and Lasso, maintaining accurate booking data by client, region and workflow. - Communicate availability, bookings, changes and confirmations to talent, Regional Managers and clients. - Support cost tracking, reconciliation, time and expense approval and general production administration. - Maintain the Flex roster database, profiles, portfolios, availability and skills data. - Contribute to monthly metrics, quarterly business reviews and operational reporting. - Support the creation and maintenance of SOPs and workflow documentation. - Provide exceptional customer service to clients, talent and internal partners at all times. - Support the establishment and transition of scheduling and resourcing tools Onboarding and Client Provisioning: - Coordinate onboarding workflows for Managed Services talent, including documentation, provisioning, client system access, compliance steps and first day readiness. - Partner with Account Management, Resource Managers and client POCs to ensure a seamless, accurate onboarding experience. - Manage system access requests, device provisioning, SharePoint or distribution list updates and any associated Tech Ops coordination. - Track onboarding progress, identify risks or delays and escalate issues when required. - Support the creation of onboarding documentation, training materials and SOPs to improve process accuracy and transparency. - Maintain accurate onboarding records, audit documentation, tracking sheets and reporting. - Provide clear and timely communications around onboarding status, expectations and required actions for both internal teams and clients. Cross-Functional Collaboration: - Work closely with Regional Managers to support coverage models across time zones and maintain smooth handovers between Europe, East and West. - Support volume spikes or urgent onboarding or scheduling needs across any region. - Partner with Creative Ops, Talent teams and Tech Ops on shared workflows, access requirements and troubleshooting. - Participate in special projects across Resource Operations, including tooling improvements, process redesign and documentation initiatives. Standards, Communication and Quality: - Maintain a high standard of communication, documentation and organization across scheduling and onboarding workflows. - Help refine operational standards across Managed Services, contributing ideas for efficiency and consistency. - Apply sound judgement when resolving issues, prioritizing tasks or managing real-time challenges. - Support new-hire announcements or internal updates relating to onboarding, access, terms or status changes. - Support in creating Managed Services processes and standards, guides and materials Required Qualifications & Experience: - 3-5 years of experience in production operations, resource coordination, onboarding, or a related operations role. - Familiarity with studio, live or multimedia production environments. - Experience working directly with clients and managing operational requests. - Experience with system provisioning, onboarding workflows, or tool-based access management. - Professional working experience with Microsoft Outlook, Google Workspace, and video conferencing platforms. Competencies: - Excellent organizational and time-management skills. - Outstanding written and verbal communication. - Strong understanding of production workflows, scheduling and operational processes. - Proven ability to work collaboratively with cross-functional teams. - Strong problem-solving, prioritization and critical-thinking skills. - Ability to manage multiple workflows and deadlines simultaneously. - High attention to detail and accuracy in documentation and data. - Comfortable working remotely with teams across several time zones. - A proactive, adaptable, people-first approach with a commitment to white-glove service. Preferred Qualifications: - Experience with scheduling tools Monday.com and Lasso. Compensation: This full-time role offers a salary of $80,000-90,000 (prorated throughout the contract duration) depending on experience. This is a short-term project (~2 months) with possibility to extend. Advanced Systems Group LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.



