Bringing real world currency to the blockchain.
AI Research Engineer – Kernel, Inference Optimization
Location
Switzerland
Posted
57 days ago
Salary
0
Seniority
Senior
Job Description
AI Research Engineer – Kernel, Inference Optimization
Tether.to
• Drive innovation in model serving and inference architectures for advanced AI systems • Focus on optimizing model deployment and inference strategies to deliver highly responsive, efficient, and scalable performance across real-world applications • Work on a wide spectrum of systems, ranging from resource-efficient models designed for limited hardware environments to complex, multi-modal architectures that integrate data such as text, images, and audio • Adopt a hands-on, research-driven approach to develop, test, and implement novel serving strategies and inference algorithms • Engineer robust inference pipelines, establishing comprehensive performance metrics, and identifying and resolving bottlenecks in production environments • Enable high-throughput, low-latency, low-memory footprint, and scalable AI performance that delivers tangible value in dynamic, real-world scenarios
Job Requirements
- A degree in Computer Science or related field
- Ideally PhD in NLP, Machine Learning, or a related field, complemented by a solid track record in AI R&D (with good publications in A* conferences)
- Must have knowledge of Metal Shading Language (MSL)
- Proven experience in low-level kernel optimizations and inference optimization on mobile devices is essential
- Your contributions should have led to measurable improvements in inference latency, throughput, and memory footprint for domain-specific applications, particularly on resource-constrained devices and edge platforms
- A deep understanding of modern model serving architectures and inference optimization techniques is required
- Must have strong expertise in writing GPU kernels for mobile devices (i.e., smartphones)
- Practical experience in developing and deploying end-to-end inference pipelines, from optimizing models for efficient serving to integrating these solutions on resource-constrained devices is required
- Demonstrated ability to apply empirical research to overcome challenges in model serving, such as latency optimization, computational bottlenecks, and memory constraints
- You should be proficient in designing robust evaluation frameworks and iterating on optimization strategies to continuously push the boundaries of inference performance and system efficiency
- Distributed Inference Systems: Designing and optimizing high-performance inference engines using techniques like Tensor Parallelism, Pipeline Parallelism, and Expert Parallelism to handle massive models on GPU clusters
- Deep understanding of the math and structure behind Diffusion Models and Vision Transformers
- Understanding of Pruning, Quantization, Flash attention, KV Cache, Speculative Decoding (Eagle) etc.
Benefits
- Flexible work arrangements
- Professional development opportunities
Related Guides
Related Job Pages
More AI Research Scientist Jobs
AI Research Engineer – Multi-Modal Reinforcement Learning
Tether.toBringing real world currency to the blockchain.
• Conduct research on reinforcement learning algorithms for multimodal models, • Design and build reinforcement learning infrastructure that supports scalable training, • Develop and refine reward modeling strategies, • Create and curate multimodal simulation environments and datasets, • Analyze and optimize policy performance across modalities, • Investigate and develop next-generation reinforcement learning paradigms, • Publish research findings in top-tier conferences.
AI Research Engineer, Model Compression, Quantization
Tether.toBringing real world currency to the blockchain.
• Drive innovation in model compression and efficient deployment for advanced multimodal AI systems, including large language models (LLMs) and vision-language models (VLMs). • Reduce model footprint and computational cost while preserving accuracy, enabling high-performance AI to run efficiently across resource-constrained edge devices. • Apply and advance compression techniques such as quantization, knowledge distillation, and pruning. • Build robust compression pipelines, establish performance and fidelity metrics, and address bottlenecks in production inference.
• Conduct end-to-end research and engineering on vision-language models, covering training, evaluation, and optimization across the full model development lifecycle. • Design and implement post-training pipelines including supervised fine-tuning, knowledge distillation, and reinforcement learning from human feedback. • Develop and maintain high-quality multimodal datasets, including data curation, filtering, and balancing for domain-specific tasks. • Drive model efficiency and deployability, adapting models for resource-constrained environments using compression and optimization techniques. • Design and implement evaluation frameworks and benchmarks to measure model performance, robustness, and real-world task success. • Build and scale training workflows across distributed GPU infrastructure. • Identify and resolve bottlenecks in training pipelines to achieve state-of-the-art model quality on target benchmarks. • Contribute to and leverage open-source ecosystems including models, datasets, and tooling to accelerate development. • Stay current with the latest research in multimodal learning and vision-language systems, translating relevant findings into practical improvements. • Publish research findings in top-tier AI conferences and journals where applicable.
AI Research Engineer – Agentic Post-training
Tether.toBringing real world currency to the blockchain.
• Conduct end-to-end research and engineering initiatives to advance post-training of agentic and tool-use models to achieve SOTA results. • Drive broad, cross-cutting model improvements, including factuality, instruction adherence, tool/function use, multi-agent coordination, and reasoning calibration. • Design and enhance large-scale post-training systems, including data pipelines, training workflows, evaluation frameworks, and benchmark infrastructure. • Develop rigorous evaluation suites and diagnostic tools to assess model readiness for deployment. • Strengthen feedback loops from real-world product usage, incorporating both explicit and implicit user signals into post-training. • Collaborate with tooling, product, and training teams to improve the usefulness, reliability, and agentic capabilities of frontier models. • Closely liaise with research, engineering and cross-functional teams to determine which integrations are production-ready for inclusion in major model releases.
