Pathway

Role Description We are currently searching for a Machine Learning DevOps with experience in cloud and compute cluster management, scaling infrastructures, and Linux administration. Our development, ML training, and production environment is in the cloud, using several major cloud providers. We need support in managing and automating the processes, and scaling the infrastructure to growing team and production needs. - Optimize infrastructure for ML training and inference (e.g., GPUs, distributed compute). - Automate and maintain ML/LLM pipelines (data ingestion, training, validation, deployment). - Manage model versioning, reproducibility, and traceability. - Work with terabyte-large datasets. - Implement ML-centric CI/CD practices. - Monitor model performance and data drift in production. - Collaborate with machine learning engineers, software engineers, and platform teams. The role focuses on operationalizing machine learning models, ensuring scalability, reliability, and automation across the ML lifecycle. Qualifications - Very good familiarity with Linux, shell scripts, and cluster configuration scripts as the basic work tool. - Proficiency in workload management, containerization and orchestration (Slurm, Docker, Kubernetes). - Solid grasp of CI/CD tools and workflows (GitHub Actions, Jenkins, Gitlab CI, etc.). - Cloud infrastructure knowledge (AWS, GCP, Azure) – especially in ML services (e.g., SageMaker Hyperpod, Vertex AI). - Familiarity with monitoring/logging tools (Grafana, CloudWatch, Prometheus, Loki). - Experience with infrastructure as code (Terraform, CloudFormation, cluster-toolkit). - Experience with ML pipeline orchestration tools (e.g., MLflow, Kubeflow, Airflow, Metaflow). - Programming skills in Python (with exposure to ML libraries like TensorFlow, PyTorch). - Experience with cluster, systems, and networks administration. - Willingness to learn. - This position holds a minimum requirement of a BSc in Computer Science or Information Technology. - We will generally favor candidates who have undertaken ambitious efforts in the past. Requirements - Experience with contributions to the Linux kernel, important bug bounties, or supporting an academic grid/cluster computing team in a scaling effort. - Achievements such as winning a sports championship should be mentioned in your application. Benefits - Intellectually stimulating work environment. - Be a pioneer: work with real-time data processing & AI. - Work in one of the hottest AI startups, with exciting career prospects. - Responsibilities and ability to make significant contributions to the company’s success. - Inclusive workplace culture. Further Details - Type of contract: Permanent employment contract. - Preferable joining date: Immediate. - Compensation: based on profile and location. - Location: Remote work with the possibility to work or meet with team members in offices located in Palo Alto, CA; Paris, France; or Wroclaw, Poland. - Candidates based anywhere in the EU, United States, and Canada will be considered.

• Proactively identify, prioritize, and curate relevant public and client-driven benchmarks across our target use cases and markets. • Evaluate candidate benchmarks for clarity, data quality, evaluation methodology, and fit with our model roadmap. • Run benchmarks with baseline models to validate setup, uncover edge cases, and de‑risk R&D runs. • Hand off “benchmark-ready” packages to R&D (specs, data, evaluation scripts, expected metrics, constraints). • Maintain a shared vocabulary and documentation around benchmarks, datasets, and evaluation formats that GTM and R&D can both use. • Track and organize benchmark results, model leaderboards, and “what good looks like” for different customers and scenarios. • Contribute to demos and public‑facing proof points based on benchmark outcomes.

• Proactively identify, prioritize, and curate relevant public and client-driven benchmarks across our target use cases and markets. • Evaluate candidate benchmarks for clarity, data quality, evaluation methodology, and fit with our model roadmap. • Run benchmarks with baseline models to validate setup, uncover edge cases, and de-risk R&D runs. • Hand off “benchmark-ready” packages to R&D (specs, data, evaluation scripts, expected metrics, constraints) • Maintain a shared vocabulary and documentation around benchmarks, datasets, and evaluation formats that GTM and R&D can both use. • Track and organize benchmark results, model leaderboards, and “what good looks like” for different customers and scenarios. • Contribute to demos and public-facing proof points based on benchmark outcomes.

Role Description You will design and execute rigorous benchmarks and define dataset standards. Collaborating closely with our R&D team, you will build the evaluation infrastructure that guides the evolution of Pathway’s post‑transformer models. - Proactively identify, prioritize, and curate relevant public and client-driven benchmarks across our target use cases and markets. - Evaluate candidate benchmarks for clarity, data quality, evaluation methodology, and fit with our model roadmap. - Run benchmarks with baseline models to validate setup, uncover edge cases, and de‑risk R&D runs. - Hand off “benchmark-ready” packages to R&D (specs, data, evaluation scripts, expected metrics, constraints). - Maintain a shared vocabulary and documentation around benchmarks, datasets, and evaluation formats that GTM and R&D can both use. - Track and organize benchmark results, model leaderboards, and “what good looks like” for different customers and scenarios. - Contribute to demos and public‑facing proof points based on benchmark outcomes. You will play a key role in defining and driving the benchmarking process for AI model evaluation. Your work will directly influence what we build, how we talk about it, and how customers and the market experience BDH. Qualifications - You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions. - You have significantly contributed to an LLM training effort which became newsworthy (topped a Hugging Face benchmark, best in class model, etc.), preferably using multiple GPUs. - You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA). - You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School. Requirements - Have experience with ML/LLM evaluation, data science, or technical product roles, ideally around benchmarks or experimentation. - Are comfortable reading papers, leaderboards, and Github repos, and turning them into clear, repeatable benchmark specs. - Can talk comfortably with both engineers and customers, and translate between technical detail and business value. - Care about high‑quality data, reproducible experiments, and crisp documentation. - Are respectful of others. - Are fluent in English. Bonus Points - Published or open‑sourced work on LLM evaluation, benchmarking or data quality. - Experience designing custom benchmarks or evaluation protocols for novel model capabilities. Benefits - Join an intellectually stimulating work environment. - Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data. - Be part of one of an early-stage AI startup that believes in impactful research and foundational changes. Type of Contract Full-time, permanent Preferable Joining Date Immediate. The positions are open until filled – please apply immediately. Compensation Based on profile and location. Location Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. Candidates based anywhere in the EU, UK, United States, and Canada will be considered. Additional Information If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.

About Pathway At Pathway we are shaking the foundations of artificial intelligence by introducing the world’s first post-transformer model that adapts and thinks just like humans. Our breakthrough architecture outperforms Transformer and provides the enterprise with full visibility into how the model works. Combining the foundational model with the fastest data processing engine on the market, Pathway enables enterprises to move beyond incremental optimization and toward truly contextualized, experience-driven intelligence. We are trusted by organizations such as NATO, La Poste, and Formula 1 racing teams. Pathway is led by co-founder & CEO Zuzanna Stamirowska, a complexity scientist who created a team consisting of AI pioneers, including CTO Jan Chorowski who was the first person to apply Attention to speech and worked with Nobel laureate Geoff Hinton at Google Brain, as well as CSO Adrian Kosowski, a leading computer scientist and quantum physicist who obtained his PhD at the age of 20. The company is backed by leading investors and advisors, including Lukasz Kaiser, co-author of the Transformer (“the T” in ChatGPT) and a key researcher behind OpenAI’s reasoning models. Pathway is headquartered in Palo Alto, California. The opportunity Starting from the very first days of “product packaging”, you will be helping Pathway to achieve key goals such as: driving adoption of our product as a useful tool, raising awareness of the company as a thought leader among developers, and decreasing time-to-deployment / time-to-value of the product. The developers using our product will mostly be in a corporate environment (both enterprise and large scale-ups). Our development framework is one day expected to become for them a part of their preferred development and data stack for data pipelines and analytics projects at work – their daily bread & butter. Responsibilities Develop and execute a comprehensive developer relations and community engagement strategy to foster relationships and grow Pathway's developer community. Represent Pathway's products and services at industry events, meetups, and other relevant forums to engage with key stakeholders in the developer community. Some examples of persona's who are interested in Pathway are Solution Architects, Data Engineers and Chief Data Officers. Create compelling content to support developer outreach and engagement, including blog posts, social media updates, webinars, and other educational resources. Work closely with Pathway's product and engineering teams to identify and document key use cases and best practices for developers building on Pathway's platform. Collaborate with the growth and Product Marketing team to digitize or personalize growth initiatives Measure and report on the success of developer relations and community engagement initiatives, and use data insights to optimize future programs. Manage communication and relationships with relevant industry forums, associations and organizations to stay up to date on trends and best practices in the field of stream processing and data engineering. Requirements Benefits Why You Should Apply Intellectually stimulating work environment. Be a pioneer: you get to work with realtime data processing & AI. Work in one of the hottest AI startups, with exciting career prospects. Team members are distributed across the world. Responsibilities and ability to make significant contribution to the company’ success Compensation: annual salary of €60K-€100K + Employee stock option plan (GENEROUS for an experienced profile) + performance-related bonus. Inclusive workplace culture Further details Type of contract : Permanent employment contract Preferable joining date : Immediate. Compensation : Depends on the area you apply from (e.g in the USA it's $130K base) + Employee stock option plan (GENEROUS for an experienced profile) + performance-related bonus. Location : Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. Candidates based anywhere in the EU, United States, and Canada will be considered.