Winning combination of software products for iGaming
Senior Software Developer in Test, Python
Location
Poland
Posted
3 days ago
Salary
0
Seniority
Senior
Job Description
Senior Software Developer in Test, Python
SOFTSWISS
• Analyze requirements and define the testing approach for new features and product changes • Automate test cases using the existing framework based on Python and PyTest • Build automated quality evaluation pipelines for AI systems using metrics and LLM-as-judge approaches • Test MCP servers, tool schemas and tool-call behavior, including edge cases and invalid arguments • Evaluate agentic workflows, including tool selection, multi-step reasoning, error handling, loop recovery and state correctness • Maintain and improve the test automation framework and contribute to internal testing tools, including mocks • Prepare and maintain test documentation, including checklists, test cases and quality reports • Participate in test design, estimations, release testing and product quality assessment • Contribute to CI/CD and QA process improvements • Design and maintain evaluation suites and golden datasets for RAG and agentic flows • Perform adversarial testing for AI systems, including prompt injection, jailbreaks, tool misuse and data leakage risks • Set up regression checks for changes in prompts, models, retrieval settings and chunking strategies • Track AI system quality together with cost, latency and token usage • Use tracing and observability tools to debug, measure and improve LLM application behavior
Job Requirements
- 5+ years of experience in Quality Assurance, including both manual and automation testing
- Solid understanding of QA principles, test design, test coverage, test pyramid and SDLC
- Experience with Python-based test automation frameworks, such as PyTest, Behave or similar
- Experience with CI/CD and monitoring or alerting tools, such as Datadog, ELK, Sentry or similar
- Interest in testing AI/LLM-based systems. Hands-on experience is preferred, but we are also open to candidates who can learn quickly and want to grow in this area
- Familiarity with RAG, LLM evaluation and quality metrics, such as groundedness, faithfulness, answer relevance and retrieval quality
- Experience or interest in AI evaluation tools, such as RAGAS, DeepEval, promptfoo, LangSmith Eval, TruLens, Arize Phoenix or similar
- Understanding of how to test non-deterministic systems, where there may be no single correct output
- Familiarity with LangChain, LangGraph, MCP, vector databases, semantic search or LLM observability tools would be a strong plus
- Good spoken and written English (B2 level or higher)
Benefits
- Full-time work opportunities
- Private insurance
- An additional Day Off (1) per calendar year
- Sports program compensation
- Comprehensive Mental Health Programme
- Free online English lessons with native speakers
- Generous referral program
- Training, internal workshops, and participation in international professional conferences and corporate events
Related Guides
Related Job Pages
More Backend Engineer Jobs
• .NET, .NET Core, C#, ASP.NET, WCF, MVC, SQL ve Nesne Yönelimli Programlama (OOP) konularında yeni uygulamalar ve servisler geliştirmek • Mevcut sistemlerde bakım, iyileştirme ve refactor çalışmaları yapmak • API entegrasyonları geliştirmek ve yönetmek • Mikroservis mimarisine dönüşüm projelerinde görev almak • Veritabanı performansını analiz etmek ve optimize etmek • Sistem performansını ve hata kayıtlarını takip ederek iyileştirmeler yapmak • Teknik dokümantasyon süreçlerine katkı sağlamak
Senior Software Engineer – Front End/Back End
Ad HocAd Hoc delivers stable, fast, and scalable technology services for governments at the federal and state levels. The company was established by two members of th
• Serves as an experienced individual contributor within a team, expected to further develop leadership, guidance and mentoring skills • Responsible for supporting the goal of meeting scope, schedule and delivery requirements • Impacts the long-term goals of the program while contributing to the implementation of the program's development strategy • May serve as the discipline's primary lead when working with stakeholders • Diagnoses and effectively resolves issues with the systems they own, informs educational opportunities and system improvements • Actively mentors and assists more junior engineers in the development of their skills
• Lead the design and development of significant software features or projects. • Mentor junior and mid-level engineers and provide technical guidance. • Collaborate with cross-functional teams to refine and prioritize software requirements. • Participate in code reviews and maintain high-quality code standards. • Investigate and resolve complex technical issues and bottlenecks. • Contribute to the improvement of development processes and software architecture. • Collaborate with cross-functional teams to debug and improve products. • Document and demonstrate solutions by developing documentation, code comments, and clear, efficient code. • Assist in code reviews and enforce standard practices within the team. • Continuously learn and adapt to modern technologies and development practices.
API Developer
ZensarAt Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus. Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.
Role Description The API Developer will design, develop, and maintain RESTful/GraphQL APIs, ensuring efficient system integration across platforms such as ERP, CRM, and cloud applications. The role involves working with: - Microservices architecture - API gateways - Middleware While ensuring: - Performance optimization - Security compliance - Reliability The developer will collaborate with cross-functional teams in an offshore delivery model, supporting global stakeholders and contributing to enterprise API strategy and governance. Company Description At Zensar, we’re “experience-led everything.” We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: - Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: - One Zensar - Nurturing - Empowering - Client Focus Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to: - Grow - Own - Achieve - Learn We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to: - Race - Creed - Color - Ancestry - Religion - Sex - National origin - Citizenship - Age - Sexual orientation - Gender identity - Disability - Marital status - Family medical leave status - Protected veteran status
