Kurs JavaScript Online!
QA Analyst (AI Systems)
Location
Italy
Posted
62 days ago
Salary
0
Seniority
Mid Level
No structured requirement data.
Job Description
QA Analyst (AI Systems)
CodeRoad
About CodeRoad CodeRoad provides end-to-end software development services, helping businesses scale with ideal infrastructure solutions. From staff augmentation to dedicated IT teams and general software engineering, our nearshore technology services empower businesses to thrive in an ever-evolving digital landscape. About the Role We’re looking for a QA Analyst specialized in modern AI systems. You’ll be responsible for validating not only APIs and performance, but also the behavior and reliability of AI-driven outputs. This role goes beyond traditional QA — you’ll test intelligent systems, not just deterministic ones. Key Responsibilities - Design and execute test strategies for AI-powered APIs and workflows - Validate agent inputs/outputs and ensure consistency and reliability - Perform API testing, exploratory testing, and automated testing - Run performance, load, and bulk testing scenarios - Collaborate with engineers to identify edge cases in AI behavior - Contribute to testing frameworks for LLM-based systems Requirements - 3+ years of experience in QA (Automation + Manual). - Strong API Testing: Expert level with Postman, Insomnia, or RestAssured. - Automation Specialist: Proficient in Playwright or Selenium for end-to-end flows. - Performance & Scale: Experience with Load/Bulk testing using Locust or JMeter. - AI/LLM Validation: Familiarity with testing Agentic workflows, validating AI payloads, and using tools like LangSmith. - Observability: Exposure to OpenTelemetry for tracing and system monitoring. - Analytical Rigor: Ability to design test cases for non-linear, agentic AI tasks. - Advanced English: Fluent for documentation and global collaboration. Nice to Have - Experience testing AI/ML systems - Familiarity with LangSmith or similar tools - Experience with MLFlow or model evaluation frameworks What You’ll Love - 100% Remote - Holidays off - Paid Time Off - Health insurance assistance program - Competitive USD compensation - Strong team culture and collaborative environment - Ongoing training and growth opportunities
Related Guides
Related Categories
Related Job Pages
More Artificial Intelligence Jobs
AI Specialist – Process Optimization, Automation
Remote RavenGrow Your Business Seamlessly & Cost Effectively.
• Identify and evaluate AI tools and platforms (e.g., ChatGPT, Zapier, Make.com, Notion AI, Midjourney, Copy.ai, etc.) to improve business processes • Develop and document AI-enhanced workflows for recruitment, lead generation, onboarding, task management, content creation, and reporting • Build custom automations or prompt-based solutions to reduce manual tasks • Collaborate with leadership and department heads to implement AI across teams • Train staff on prompt engineering, AI best practices, and tool usage • Research new AI trends and recommend tools that align with business goals • Analyze impact and performance of AI tools; continuously improve efficiency and scalability • Support internal projects like chatbot implementation, knowledge base structuring, and candidate/client data enrichment
Senior Technical Director - AI UX
Rocket CompaniesRocket Money offers a mobile app that helps people take back the control of their money and “live their best financial lives.” Formerly known as Truebill, the company has offer
It's fun to work in a company where people truly BELIEVE in what they're doing! Job Description Summary: Rocket Software a leading provider of enterprise modernization software is expanding its AI strategy and leading the application of AI to further our vision of “Modernization Without Disruption”. With AI offerings like SmartChat, Anomalytics and Rocket Eva, Rocket is an established player in the application of AI in the modern enterprise. Rocket is expanding its AI strategy and is seeking a Senior Technical Leader to join Rocket’s AI COE to define how intelligence is embedded into enterprise workflows across our product portfolio. The Senior Technical Director for AI User Experience will set the long-term vision for how users collaborate with AI-driven capabilities across copilots, contextual assistants, multimodal interfaces, and intelligent automation to ensure these experiences are intuitive, trustworthy, governable, and enterprise-grade. This role will define Rocket’s cross-product AI experience architecture, establishing reusable patterns, constraints, and principles for AI-powered interactions as the market evolves. The successful candidate will ensure consistency, responsibility, and impact in how AI augments human decision-making across Rocket’s products, particularly in complex, regulated, and mission-critical environments. Essential Duties & Responsibilities • Define Rocket's AI-driven experience strategy across all product lines, with a focus on embedding intelligence into enterprise workflows, decision paths, and operational systems. • Architect reusable, scalable experience frameworks and primitives for AI copilots, contextual assistance, and multimodal interactions, emphasizing trust, clarity, and human control. • Establish and enforce patterns for transparency, explainability, governance, and responsible AI use, translating policy and platform constraints into effective user experiences. • Partner with Product, UX, and Engineering leadership to integrate AI experience patterns into product roadmaps and platform architecture, and to challenge designs that compromise trust or usability. • Lead applied R&D exploration of next-generation AI interaction models focused on improving human-machine collaboration, reducing cognitive load, and enabling safe automation. • Publish internal and external thought leadership to help shape Rocket's point of view on enterprise AI experiences. • Engage directly with customers and industry partners to validate AI interaction models against real-world operational needs and constraints. • Mentor senior engineers and influence technical direction across teams, serving as a key architectural authority for AI-driven experiences. Required Qualifications • 12+ years of experience in software engineering, AI/ML systems, UX architecture, HCI, or related technical disciplines. • Deep experience designing and delivering AI-enabled user experiences in complex software systems. • Strong technical understanding of ML/NLP concepts and the ability to work effectively with AI engineering teams. • Demonstrated ability to simplify complex, high-stakes workflows using intelligence-driven design. • Excellent communication skills with the ability to influence across engineering, product, and design organizations. Preferred Qualifications • Experience building enterprise software for technical or operational users (e.g., infrastructure, analytics, DevOps, data platforms, modernization). • Familiarity with responsible AI design, explainability, auditability, or compliance-oriented UX patterns. • Experience with multimodal interaction models, including chat-based interfaces, visual reasoning cues, or voice, where appropriate. • Advanced degree in Computer Science, HCI, AI/ML, or a related field. #LI-Remote Annual salary range for this position is between $174,500.00 - $235,575.00 gross before taxes. . What Rocket Software can offer you in USA: - Unlimited Vacation Time as well as paid holidays and sick time - Health and Wellness coverage options for Rocketeers and dependents - Life and disability coverage - Fidelity 401(k) and Roth Retirement Savings with matching contributions - Monthly student debt benefit program - Tuition Reimbursement and Certificate Reimbursement Program opportunities - Leadership and skills training opportunities EOE M/F/Vet/Disability. Rocket Software Inc. is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. Rocket Software Inc. is also committed to compliance with all fair employment practices regarding citizenship and immigration status. Rocket is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. If you need special assistance or an accommodation while seeking employment, please call: 781-577-4321 or send an email to people@rocketsoftware.com. We will make a determination on your request for reasonable accommodation on a case-by-case basis. As part of our commitment to a safe and trustworthy workplace, we include background and reference checks in our hiring process. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Remote Field Service Technician III Location: Remote Ohio Working hours: 40-60 DEUTZ is one of the world’s leading manufacturers of innovative drive systems. Its core competences are the development, production, distribution and servicing of diesel, gas and electric drivetrains for professional applications that is used in construction equipment, agricultural machinery, material handling equipment, stationary equipment, commercial vehicles, rail vehicles and other applications. Job Summary: The Remote Field Service Technicians are creative mechanic marvels that contribute to the organization’s success by providing expertise in field service troubleshooting, installations, and repair of our machinery. The Remote Field Service Technician will perform field-related preventative maintenance and routine repairs on all DEUTZ products and Non-DEUTZ Construction Equipment operating within the DEUTZ Power Center. The Remote Field Service Technician will liaise with our Service Supervisor, Parts Dept, Customers, New engine sales and engineering/warranty department. This role requires robust problem-solving skills with the ability to adapt and work in a team environment. The ideal candidate must be personable, reliable, ethical, and intelligent with a diligent and hard-working drive. Essential Duties and Responsibilities The Remote Field Service Technician will be responsible for, but not limited to, the following duties: - Travel to customer(s) locations to perform engine and equipment-related repairs. - Assist in resolving customer-related issues in a timely manner. - Work with all employees and supervisors to ensure the facility is clean and organized and presents a positive image of DEUTZ. - Plan methods and sequence of performing repairs assigned. - Pre-order all parts and materials required to perform assigned repairs. - Inspect required repairs safely and effectively. - Ensure all repairs are completed as assigned and according to manufacturer requirements. - Ensure proper cosmetic appearance upon completion of repairs. - Ensure all parts and materials not used are returned per DEUTZ Power Center return parts guidelines. - Maintain and keep the work area in a clean and safe condition. - Communicate with customers in a respectful and honest manner. - Match all identified solutions necessary to affect repair. - Complete all work orders and time sheets in a timely manner. - Consult, when necessary, with the DEUTZ Service Department ticket system to ensure the accuracy and approval of repairs. - Ensure vehicle parts inventory is maintained at a suitable level for first-call completions and local parts sales. - Perform all work in accordance with all established policies and procedures. - Assist in the proper filing of warranty claims and customer invoices. - Follow all DEUTZ employee policies and procedures, especially pertaining to travel and company credit cards. - Maintains and cleans service trucks meeting DOT requirements. - Other duties as assigned. Other Qualifications - Strong experience in diagnosis, and repair of NG/CNG, Tier 3-4 emissions level preferred. - Ability to develop exceptionally strong working knowledge of DEUTZ Diesel engines. - Ability to work with minimal supervision. - Meet all local/state and company requirements to operate a company-assigned service vehicle. - Excellent communication skills (writing, speaking in person, and over the phone). - Proficient in the use of basic computer functions and portable diagnostic tools. - Must have your own tools. Key DEUTZ tools will be provided. Supervisory Responsibility - None Travel Requirements - Anticipated domestic and international travel is approximately 100% depending on business needs within the region. Minimum Requirements - High School Graduate or General Education Degree (GED) - Must be able to maintain DOT medical card status - Must have a valid driver’s license and be insurable by the company - 4+ years as shop technician experience or 2+ years as a field service technician Preferred Requirements - Two years of Diesel engine experience. - 2-5 years of construction equipment repair experience preferred - Strong computer usage with the ability to effectively utilize software including Serdia, Serpic, Fieldaware, Word, and Excel - Certification/Training in heavy equipment and diesel engine repairs preferred Physical Requirements: Manufacturing assembly and warehouse environments. Subject to noise, dust, diesel fuel, oil, and extreme hot/cold temperatures. No A/C. The above job description is not intended to be an all-inclusive list of duties and standards of the position. Incumbents will follow any other instructions, and perform any related duties, as assigned by their supervisor. #LI-DNI EEO Statement DEUTZ is an equal opportunity employer and considers all applicants for employment based on merit, competence, performance, and business needs. We do not discriminate on the bases of any status protected under federal, state, or local law. Applicants will be considered regardless of their race, color, sex, gender identity or expression, age, religion, creed, national origin, citizenship status, sexual orientation, genetic information, physical or mental disability, military status or any other characteristic protected under federal, state, or local law. In addition to complying with all applicable laws, DEUTZ also has a strong corporate commitment to inclusion.
Manager of Artificial Intelligence Solutions
Acentra Health, LLCAcentra Health exists to empower better health outcomes through technology, services, and clinical expertise. Our mission is to innovate health solutions that deliver maximum value and impact. Lead the Way is our rallying cry at Acentra Health. Think of it as an open invitation to embrace the mission of the company; to actively engage in problem-solving; and to take ownership of your work every day. Acentra Health offers you unparalleled opportunities. We are a team of experienced and caring leaders, clinicians, pioneering technologists, and industry professionals who come together to redefine expectations for the healthcare industry. State and federal healthcare agencies, providers, and employers turn to us as their vital partner to ensure better healthcare and improve health outcomes. You will have meaningful work that genuinely improves people's lives across the country. We are a company that cares about our employees, and we give you the tools and encouragement you need to achieve the finest work of your career.
Company Overview Acentra Health exists to empower better health outcomes through technology, services, and clinical expertise. Our mission is to innovate health solutions that deliver maximum value and impact. Lead the Way is our rallying cry at Acentra Health. Think of it as an open invitation to embrace the mission of the company; to actively engage in problem-solving; and to take ownership of your work every day. Acentra Health offers you unparalleled opportunities. In fact, you have all you need to take charge of your career and accelerate better outcomes – making this a great time to join our team of passionate individuals dedicated to being a vital partner for health solutions in the public sector. Job Summary and Responsibilities Acentra Health is looking for a Manager of Artificial Intelligence Solutions to join our growing team. Job Summary: The AI Solutions position plays a critical role within Acentra Health’s AI & Automation Center of Excellence (COE), serving as the accountable solution lead for AI initiatives progressing beyond early-stage intake and discovery. This role assumes leadership at the L2 and L3 business case stages, translating approved concepts into structured pilots and proof-of-concept (POC) solutions that are viable, measurable, and ready for enterprise transition. Operating similarly to a product manager within the COE model, the Manager of AI Solutions drives initiative design and requirements, coordinates cross-functional development efforts, embeds responsible AI and adoption considerations, and ensures clean handoffs to Product and Technology for scale. This is not a people management role, but a high-accountability individual contributor position focused on execution discipline, delivery quality, and value realization. Responsibilities: - Assume solution leadership for AI initiatives advancing past L1 intake, leading L2/L3 business case refinement, pilot definition, and execution planning. - Collaborate with the Business Analyst to translate business cases into actionable requirements, align with AI Engineering on design and build plans, and coordinate delivery tracking with the Project Manager and Scrum Master. - Coordinate cross-functional pilot development efforts across Business Analysts, AI engineers, data teams, and operational stakeholders. - Embed responsible AI practices, governance checkpoints, and risk awareness into pilot design in alignment with Acentra Health’s AI standards and regulatory expectations. - Partner with the Transformation Office, Change Management, Business Lines, and Product to assess workflow readiness, adoption considerations, and operational impacts prior to pilot deployment. - Define and track pilot success criteria, ensuring value realization is measurable and documented prior to transition. - Plan and execute structured handoff to Product and Technology teams, ensuring clarity of requirements, constraints, risks, and performance expectations. - Collaborate with the AI Portfolio Manager and VP of AI & Automation on portfolio prioritization, design patterns contributing to repurposing scale-ready solutions, and continuous improvement of the COE operating model. - Read, understand, and adhere to all corporate policies including policies related to HIPAA and its Privacy and Security Rules. The list of accountabilities is not intended to be all-inclusive and may be expanded to include other education- and experience-related duties that management may deem necessary from time to time. Qualifications Required Qualifications - Bachelor’s degree in Business, Healthcare Administration, Analytics, Information Systems, or related field; equivalent experience considered. - 3+ years of experience in business analysis, product coordination, solution delivery, or technology-enabled transformation initiatives. - Demonstrated experience translating business requirements into structured solution designs or pilots. - Experience working cross-functionally with technical teams (engineering, data science, product) and operational stakeholders. - Strong understanding of AI and automation concepts and their application within regulated or healthcare environments. - Experience defining KPIs, success metrics, and measuring value realization for technology initiatives. - Strong written and verbal communication skills with the ability to influence without direct authority. Preferred Qualifications - Experience working within an AI, Automation, or Digital Transformation Center of Excellence model. - Familiarity with responsible AI frameworks (e.g., NIST AI Risk Management Framework) and governance best practices. - Experience supporting healthcare operations, care management, claims administration, or public sector programs. - Background in lightweight product management, pilot execution, or innovation program leadership. Why us? We are a team of experienced and caring leaders, clinicians, pioneering technologists, and industry professionals who come together to redefine expectations for the healthcare industry. State and federal healthcare agencies, providers, and employers turn to us as their vital partner to ensure better healthcare and improve health outcomes. We do this through our people. You will have meaningful work that genuinely improves people's lives across the country. We are a company that cares about our employees, and we give you the tools and encouragement you need to achieve the finest work of your career. Benefits Benefits are a key component of your rewards package. Our benefits are designed to provide you with additional protection, security, and support for both your career and your life away from work. Our benefits include comprehensive health plans, paid time off, retirement savings, corporate wellness, educational assistance, corporate discounts, and more. Thank You! We know your time is valuable and we thank you for applying for this position. Due to the high volume of applicants, only those who are chosen to advance in our interview process will be contacted. We sincerely appreciate your interest in Acentra Health and invite you to apply to future openings that may be of interest. Best of luck in your search! ~ The Acentra Health Talent Acquisition Team Visit us at https://careers.acentra.com/jobs EEO AA M/F/Vet/Disability Acentra Health is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, disability, status as a protected veteran or any other status protected by applicable Federal, State or Local law. Experience in Lieu of Degree For non-clinical roles, or when not required by the contract specifically, the Company acknowledges that practical, hands-on experience can provide skills and competencies equivalent to formal education. As such, in cases where a Bachelor's degree may be required, the Company will accept a minimum of six (6) years of directly relevant professional experience in lieu of a degree. In instances where the candidate has an Associate's degree, the Company will accept a minimum of three (3) years of directly relevant professional experience in lieu of the Bachelor's degree. Compensation The pay for this position is listed below. "Based on our compensation philosophy, an applicant’s position placement in the pay range will depend on various considerations, such as years of applicable experience and skill level." Pay Range USD $103,600.00 - USD $129,500.00 /Yr.


