HugeInc logo
HugeInc

Huge is a design and technology company. We create products and experiences that grow the world’s most ambitious brands. We believe all experiences should be intelligent, shoppable, and unique to every brand. Huge’s nearly 1,000 thinkers, tinkerers, makers, and creators have been problem-solving across North America, Europe, and Latin America for over 25 years. Huge is committed to creating an inclusive employee experience for all. Huge is an equal opportunity employer (EOE) and strongly supports diversity in the workforce.

QA Lead

QA Automation EngineerQA Automation EngineerFull TimeRemoteLeadTeam 1,001-5,000

Location

Colombia

Posted

9 days ago

Salary

0

Seniority

Lead

No structured requirement data.

Job Description

QA Lead

HugeInc

Role Description We are seeking a seasoned, battle-tested QA Lead & AI Brand Evaluation Strategist to take full ownership of the quality, integrity, and strategic evaluation of our rapidly expanding suite of agentic and AI-powered product features. This is not a traditional, checklist-driven QA role. You will operate in a highly dynamic, non-deterministic environment, leading the strategy to evaluate probabilistic software at scale. Your core mission is to transform complex, ambiguous business requirements into robust evaluation criteria and scoring systems. You will lead the design of tools and frameworks that process massive volumes of data, ensuring our brand scoring metrics are precise, reliable, and actionable. What you'll do - Strategic QA Leadership: Own the end-to-end testing and evaluation strategy for multi-agent architectures and high-volume data pipelines, defining direction even when product requirements are fluid or ambiguous. - Business-to-Evaluation Translation: Act as the primary bridge between Product, Data Science, and Engineering. Translate complex business objectives into concrete, data-driven evaluation criteria and operational rubrics. - Brand Scoring Architecture: Oversee the methodology for scoring brands against complex criteria, ensuring that automated systems accurately transform massive datasets into precise, reliable business metrics (e.g., Share of Model, Net Sentiment). - Framework & Tool Building: Drive the creation of internal tools, data-driven testing pipelines, and validation frameworks capable of handling non-deterministic AI outputs and large-scale information ingestion. - System Integrity & Governance: Establish risk-adaptive guardrails and checkpoints to ensure data precision, compliance (PII), and logical reasoning across complex, multi-step agentic workflows. - Lead & Orchestrate Evaluation Frameworks: Define, architect, and oversee validation processes for application layers, complex API workflows, and the data transformation engine. - Define Brand Scoring Criteria: Establish the mathematical and logical rules that operate over massive data volumes to audit whether brand evaluations match underlying raw metrics reliably. - Direct "Golden" Test Set Curation: Lead the strategy for compiling, synthesizing, and maintaining massive baseline validation datasets to test edge cases, user intent, and model drift. - Drive Adversarial & Ambiguity Testing: Design "red-teaming" scenarios and boundary testing to evaluate how gracefully the system handles prompt variations, conversational drift, and highly ambiguous data inputs. - Tooling Innovation: Collaborate with engineering to build proprietary testing tools or automation scripts that streamline the ingestion and analysis of high-volume data for QA purposes. - Defect Profiling & Root-Cause Strategy: Move beyond simple bug logging; analyze trends in statistical behavioral defects and guide cross-functional teams toward systemic root-cause resolution. - Platform Observability & Metrics: Monitor cloud logging and data observability dashboards to track execution latency, data drift, and accuracy trends, transforming insights into platform optimizations. Qualifications - 8+ years of proven experience in QA Engineering, Systems Analysis, or Software Testing, with at least 2+ years in a Lead or Strategic role managing complex, data-heavy digital platforms. - Proven "cancha" (battle-tested experience) leading QA initiatives in fast-paced environments where requirements are not fully defined, showing a high capacity to resolve ambiguity and establish order. - Strong data-driven background. Exceptional capability to shift away from purely binary (pass/fail) testing toward evaluating data trends, composite scoring, and statistical outcomes. - Comfortable working with big data contexts—understanding how information flows from raw ingestion (data lakes) through transformation layers to user-facing dashboards. - Deep expertise in traditional and modern software testing methodologies, Agile environments, risk management, and project tracking ecosystems (such as JIRA). - Practical experience with Python, JavaScript, or SQL to query databases, manipulate data structures, and trigger/build automated evaluation pipelines. - Deep operational awareness of LLM behaviors, agentic workflows, and typical AI challenges (hallucinations, context limits, instruction adherence). Preferred Skills and Qualifications - Experience with LLM evaluation frameworks (e.g., Ragas, LangSmith, TruLens) or prompt engineering playgrounds. - Familiarity with cloud data warehouses and analytics platforms (e.g., BigQuery, Databricks, Google Cloud Platform components). - Experience building internal scripts or lightweight tools specifically designed to automate QA data validation.

Related Categories

Related Job Pages

More QA Automation Engineer Jobs

ClickHouse logo

Senior Security Automation Engineer

ClickHouse

ClickHouse is an open-source, column-oriented OLAP database management system.

Full TimeRemoteTeam 51-200Since 2016H1B Sponsor

• Build a Universal Provisioning Engine and custom integration layers that satisfy external auditors while keeping internal teams focused on shipping features. • Eliminate the engineering "interruption tax," provide leadership with a real-time, data-driven view of our risk posture, and ensure continuous compliance with zero audit surprises. • Engineer a centralized security telemetry system that programmatically captures control evidence and health in real-time, transitioning from manual snapshots to continuous data streams for an 'always-on' view of our security posture. • Architect solutions for systems that lack native IGA support. • Partner with our risk management function to build a secure mechanism to generate agentic risk assessments workflows using the data and results from what is collected.

Netherlands
Instawork logo

QA Intern

Instawork

The flexible work app that connects local businesses with qualified hourly workers

InternshipRemoteTeam 501-1,000Since 2016H1B Sponsor

Role Description We are looking for detail-oriented QA Clipper Interns who can watch long-form videos and create high-quality clips based on clearly defined rubrics and training provided by our team. This is a fully remote internship with daily payouts, performance incentives, and clear milestones. If you enjoy watching videos, have good attention to detail, and want to earn from home—this role is for you. Key Responsibilities - Watch long-form videos at 4x speed - Create accurate clips strictly based on QA rubrics & training - Ensure clips meet quality, timing, and relevance standards - Maintain daily productivity targets - Follow feedback and improve clipping accuracy over time Daily Target - 30 hours of video clipping per day (Achievable by watching content at 4x speed) Internship Stipend - ₹24,000 / month + bonus Job Type - Internship | Remote | Flexible Hours Our Values - Empathy, Trust & Candor: We put ourselves in the shoes of our colleagues and customers and don’t shy away from uncomfortable conversations, instead building trust through honest and direct feedback. - Bias for Action: We practice high-velocity decision-making, clear-eyed that we often operate with incomplete information. Growing quickly means it’s OK to be wrong, so long as we learn from our mistakes and course correct! - Always Be Learning: We’re a curious bunch, and with AI transforming our workplace we encourage everyone to learn from each other, compounding our knowledge and experience to help us change an entire industry. - Act Like an Owner: We work long, hard, and smart, building products that delight our users and drive growth. Your ability to impact Instawork is limited only by your courage and conviction, not your job description. Company Description Founded in 2015, Instawork is the nation’s leading online labor marketplace for food services, hospitality, light industry, and logistics, connecting more than 7M skilled workers with local restaurants, hotels, warehouses, stadiums, and more. Our AI-powered platform serves thousands of businesses across more than 50 major markets in the United States and Canada. We're not just helping fill shifts, we're supporting local economies—and we're just getting started! - Instawork has been featured by CBS News, The Wall Street Journal, The Washington Post, and the Associated Press. - Forbes included us on their Next Billion Dollar Startups list. - RetailTech Breakthrough named us Workforce Hiring Solution of the Year for 2025. - Inc. 5000 recognized us as one of the country's top 10% fastest-growing companies two years in a row. Join our team to help us build something that matters! We’re looking for superstars who want to help us shape the future of work. With hubs in San Francisco, Bangalore, and Chicago, city offices in New York, Phoenix, and Singapore, we're back to working together in-person five days a week because we believe the best ideas happen when great people collaborate face-to-face. We also value diverse perspectives and encourage applications from candidates of all backgrounds. Ready to make an impact? Learn more at www.instawork.com/about .

Worldwide
₹24K / year
Full TimeRemoteTeam 51-200Since 2010H1B No Sponsor

Role Description We are currently seeking a Quality Assurance Engineer (m/f/d) for our client in the Lucerne area. In this role, you will be responsible for the development, implementation, and verification of Quality Assurance requirements and act as the main interface between Process Engineering and Operations for all quality and safety topics. You will ensure the successful execution of the Quality Program and compliance with Product Assurance requirements at the manufacturing site. - Develop and promote Quality Assurance requirements and a strong quality culture - Ensure robust quality processes and cost-efficient program execution in collaboration with Engineering, Operations, and Supply Chain - Act as main interface for Process Engineering and Operations on quality and safety topics - Define and implement Critical-to-Quality (CTQ) characteristics and control plans - Lead non-conformance management, root cause analyses (RCA), and failure investigations - Moderate and lead Process FMEA activities - Supervise Manufacturing, Assembly, Integration and Testing (MAIT) quality aspects - Define and monitor Measuring & Test Equipment (M&TE), Measurement System Analysis (MSA), and process capability - Perform quality inspections and manage KIP/MIP documentation - Establish and maintain process quality documentation and support process qualification - Ensure compliance with customer, regulatory, and internal requirements - Contribute to proposals (RFI/RFQ), audits, and quality organization development (training & coaching) - Support product and qualification data packages, especially for space applications Qualifications - Degree (BSc/MSc) in Engineering or a related field - Relevant experience in Quality Assurance and Continuous Improvement - Knowledge of standards such as EN9100, ECSS, NASA, and MIL - Strong technical understanding and ability to analyze complex systems - Hands-on mindset combined with solid theoretical knowledge - Experience with quality tools and methodologies (e.g., 5Why, Ishikawa/Fishbone, FMEA) - Proficiency in MS Office - Experience in the space industry is an advantage - Strong analytical, critical thinking, and interpersonal skills - Independent and team-oriented working style - Proactive, communicative, and confident personality - Passion for quality and continuous improvement - Willingness to travel (approx. 5–10%) - Excellent communication skills in English (written and spoken) - Additional languages (German, French, or Swedish) are a plus Company Description Die Coopers Group AG ist eine agile Schweizer Recruiting Agentur, die Spezialisten und Führungskräfte in den Bereichen IT, Life Sciences, Engineering und Finance vermittelt. Mit flexiblen Ansätzen bringen wir Kandidat:innen und Unternehmen zusammen, die nicht nur fachlich, sondern auch menschlich zusammenpassen.

Switzerland
Job Closed
Remote Recruitment logo

WordPress Designer – Developer, Marketing Automation

Remote Recruitment

Remote Recruitment operates as a full-service employment agency providing recruitment/staffing for UK based companies

Full TimeRemoteTeam 11-50H1B No Sponsor

• Build and maintain WordPress websites • Develop custom landing pages • Create reusable page templates • Configure plugins and integrations • Maintain website performance and security • Troubleshoot technical issues • Build high-converting sales pages • Create webinar registration pages • Develop lead generation funnels • Optimise conversion paths • Implement A/B testing improvements • Improve page speed and mobile responsiveness • Integrate forms with CRM systems • Connect landing pages with automation workflows • Implement tracking pixels and analytics • Support email marketing integrations • Assist with campaign launches • Ensure seamless customer journeys • Produce clean, modern layouts • Maintain brand consistency • Design responsive experiences • Optimise UX/UI • Create graphics where required • Collaborate with branding and content teams • Improve Core Web Vitals • Optimise website speed • Improve SEO fundamentals • Enhance conversion rates • Monitor website performance • Recommend technical improvements

South Africa