• Converse with the model on software engineering tasks and technical scenarios using Python • Verify logical accuracy and coding fluency • Assess code quality and clarity • Capture reproducible error traces • Suggest improvements to prompt engineering and evaluation metrics

• Evaluate AI-generated code • Correct errors • Implement optimized Kotlin solutions • Document best practices that demonstrate modern Android design patterns and coding conventions • Create high-quality code patches that reflect modern Android development practices and ensure technical correctness, maintainability, and clarity • Produce clean, efficient, and idiomatic solutions using the Kotlin programming language based on real-world engineering scenarios

• Define, document, and validate Kotlin-based Android functionalities used in AI benchmarking and software simulation projects • Author comprehensive functional and technical documentation, including feature requirements, system behavior, and expected outcomes • Translate open-ended requirements into realistic, well-scoped Android tasks representing genuine engineering challenges • Ensure each benchmark task is complete, verifiable, and grounded in authentic developer workflows • Maintain structured repositories of Kotlin challenges, categorized by complexity, topic, and functional type • Define Kotlin-specific quality metrics, benchmarking criteria, and rubrics aligned with Android production standards • Develop SOPs and QA frameworks enforcing stylistic consistency, idiomatic Kotlin use, and functional clarity • Conduct rigorous QA passes on deliverables — verifying code correctness, documentation completeness, and benchmark adherence • Apply quality principles to maintain dataset and code task evaluation standards • Curate gold-standard Kotlin examples representing benchmark-worthy implementations • Collaborate with recruitment and project leads to define role competencies for Kotlin contributors • Develop technical evaluation frameworks for vetting Kotlin developers, including practical code tasks and debugging exercises • Lead calibration sessions with contractors to ensure consistency and quality • Create skill matrices and capability documentation for Kotlin engineering talent aligned to benchmarking needs • Provide continuous feedback and training materials for quality improvement • Collaborate with AI research teams to design and refine Android benchmarking datasets for evaluating LLM coding performance • Source, assess, and refine Kotlin-based Android tasks testing comprehension, reasoning, and problem-solving • Document evaluation criteria including accuracy, code structure, and maintainability • Contribute to post-project analysis, surfacing insights on performance trends and task design improvements • Recommend dataset refinements to enhance domain coverage • Support project setup, scoping, and execution of Kotlin-oriented AI training and evaluation projects • Provide expert-level input on tooling, frameworks, and pipeline design (Ktor, Jetpack, Gradle, KSP) • Collaborate closely with ML engineers, QA specialists, and data annotators to meet research-grade standards • Produce summary documentation and retrospective reports detailing lessons learned and recommendations

• Develop and maintain backend services, APIs, and background tasks in Python. • Work with SQL databases, with a focus on Postgres. • Collaborate on frontend features using React. • Contribute to designing and scaling background task queues and distributed systems. • Work closely with the tech lead and product team to deliver high-quality solutions.