Canva logo
Canva

Design anything. Publish anywhere.

Senior Machine Learning Engineer – Agent Tools Interop

Machine Learning EngineerMachine Learning EngineerFull TimeRemoteSeniorTeam 1,001-5,000Since 2013H1B SponsorCompany SiteLinkedIn

Location

Australia

Posted

52 days ago

Salary

0

Seniority

Senior

Bachelor DegreeEnglishJavaPythonTypeScript

Job Description

Senior Machine Learning Engineer – Agent Tools Interop

Canva

• Build and evolve the systems that enable agents to discover, invoke, and safely execute capabilities across Canva at scale • Design tool schemas and definition patterns that maximize LLM tool selection accuracy • Build and operate evaluation pipelines that measure tool calling behavior in production • Collaborate with product, platform, and GenAI teams to integrate agentic capabilities into production systems • Advise contributing teams on how to define tools agents can reliably call • Partner with platform engineers on governance, safety, and execution guarantees • Mentor engineers on agentic integration patterns and evaluation methodology

Job Requirements

  • Hands-on production experience with LLM tool-use and function calling
  • Java proficiency is essential given our backend services infrastructure
  • Python or TypeScript is a strong plus
  • Experience at the boundary of ML and platform engineering
  • Familiarity with MCP, LangChain, LangGraph, or agent frameworks is a real differentiator
  • Prompt engineering experience specifically for tool definitions and tool calling schemas

Benefits

  • Equity packages - we want our success to be yours too
  • Inclusive parental leave policy that supports all parents & carers
  • An annual Vibe & Thrive allowance to support your wellbeing, social connection, office setup & more
  • Flexible leave options that empower you to be a force for good, take time to recharge and supports you personally

Related Job Pages

More Machine Learning Engineer Jobs

Netflix logo

Machine Learning Scientist 4 - Pricing Science

Netflix

Described as the world's top internet television network, Netflix is a publicly-traded entertainment company offering video-on-demand and streaming media. As an

At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what’s next. The Team Netflix's ability to invest in the content that entertains hundreds of millions of members - billions of dollars each year across film, series, games, and live experiences - depends on getting subscription pricing right. Effective pricing generates the sustainable revenue that funds Netflix's next slate of ambitious content. The Subscription Revenue DSE team brings rigorous measurement and modeling to that challenge. We are a small, focused group of data practitioners who partner with Finance & Strategy, Product, and Consumer Insights to understand how pricing actions actually impact member behavior globally. Our work spans causal measurement of pricing impacts, elasticity, and willingness-to-pay research, and execution analytics. We own and continuously evolve the tools that give Netflix a clear-eyed, evidence-based view of what its pricing decisions actually achieve. The Role We are looking for a Machine Learning Scientist to join our team and bring deep ML and causal inference rigor to some of the hardest quantitative problems in subscription pricing. You will collaborate with other researchers to advance our causal measurement capabilities, own complex ML initiatives end-to-end, and bring deep technical rigor to some of the hardest quantitative problems in subscription pricing. You will also partner with Finance & Strategy leaders and Product managers, translating complex modeling work into clear, actionable insights that drive significant business decisions. What You Will Do - Design and implement quasi-experimental and causal inference approaches (difference-in-differences, synthetic control, instrumental variables, and related QED methods) to measure the true impact of pricing actions in observational, global datasets - Build and productionize measurement models and causal inference pipelines that estimate how pricing actions affect member behavior - from feature engineering through deployment, monitoring, and iteration - Conduct elasticity and willingness-to-pay research to deepen our understanding of member price sensitivity across global markets - Evolve our core measurement and analytics tools, integrating new science as the field advances - Partner with Finance & Strategy and Product leadership to translate statistical findings - including uncertainty - into business recommendations; push back constructively when business assumptions conflict with statistical evidence - Own your work all the way through: from ideation to production systems to learning from real-world outcomes About You - You have deep expertise in causal inference and quasi-experimental design - you can distinguish true pricing impact from correlation in messy, global observational data, and you know when findings are conclusive versus when they are not - You have a proven track record of taking ML initiatives from 0 to 1, including building, deploying, and maintaining production models - You are proficient in Python, with experience in ML and statistical libraries (e.g., scikit-learn, PyTorch, TensorFlow, or JAX) - You have experience in B2C subscription businesses and an intuition for how pricing decisions play out at scale - You are a clear communicator - you can explain complex causal and ML methodology to non-technical audiences, present uncertainty alongside conclusions, and influence decisions with rigor rather than false confidence - You are a first-principles thinker: you identify the right question before choosing the method, and you are naturally skeptical of correlational claims in pricing data - You have an advanced degree (MS or PhD) in statistics, economics, computer science, mathematics, or a related quantitative field, or equivalent applied research experience Generally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $300,000.00 - $537,000.00. This compensation range will vary based on location. Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here. Netflix is a unique culture and environment. Learn more here. Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner. We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service. Job is open for no less than 7 days and will be removed when the position is filled.

Panama
$300K - $537K / year
Netflix logo

Machine Learning Scientist 4 - Subscription Forecasting

Netflix

Described as the world's top internet television network, Netflix is a publicly-traded entertainment company offering video-on-demand and streaming media. As an

At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what’s next. The Team Netflix's ability to invest in the content that entertains hundreds of millions of members - billions of dollars each year across film, series, games, and live experiences - depends on getting subscription pricing right and having a clear view of where the business is headed. The Subscription Revenue DSE team brings measurement and modeling to both challenges. We are a small, focused group of data practitioners who work across pricing research and business forecasting. This role will focus on the forecasting work, where we partner with Finance & Strategy, Content, and Revenue Analytics teams to build the models that project Netflix's subscriber growth, engagement, and revenue across global markets over multi-year horizons. Our forecasts serve as a foundation for long-range planning across the company. The Role You will work closely with senior researchers and the team's existing data science foundation to improve the models that forecast Netflix's subscription trajectory and the expected impact of pricing decisions. The core challenge: subscription markets are noisy, global, and deeply interconnected. Understanding how the business will develop - and how pricing actions will shift that trajectory - across geographies, plan tiers, and time horizons requires strong models and honest judgment about what the data can and can't tell you. What You Will Do - Build and productionize forecasting models that capture the overall trajectory of Netflix's subscription business alongside the expected impact of pricing actions on member base, ARPU, and revenue across global markets - Build on the team's existing scenario modeling and simulation tools to quantify how pricing actions and broader market dynamics are expected to affect subscription metrics - giving decision-makers a way to stress-test assumptions before a pricing move happens - Contribute to and advance the team's forecasting pipeline - model development, backtesting, deployment, and monitoring - and lift the accuracy and reliability of existing forecasts - Partner with Finance & Strategy and Product leadership to translate forecast outputs - including their uncertainty - into concrete business recommendations About You - Solid grasp of subscription business dynamics - how acquisition, ARPU, and churn interact, and how pricing decisions move these metrics - Strong expertise across forecasting methods - such as time series, and regression-based approaches - and the trade-offs between accuracy, interpretability, and stability - Comfortable building production forecasting systems: backtesting, monitoring, catching drift, and retraining when the data changes - You incorporate macro and external signals (economic conditions, FX dynamics, competitive moves) into your models alongside internal data - Proficient in Python and SQL, with hands-on experience with ML and statistical libraries (e.g., statsmodels, PyTorch) - Advanced degree (MS or PhD) in statistics, economics, computer science, or a related quantitative field, or equivalent applied experience Generally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $300,000.00 - $537,000.00. This compensation range will vary based on location. Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here. Netflix is a unique culture and environment. Learn more here. Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner. We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service. Job is open for no less than 7 days and will be removed when the position is filled.

Panama
$300K - $537K / year
Full TimeRemoteTeam 10,001+Since 1912H1B Sponsor

• Define the technical roadmap for visual personalization, bridging the gap between ML science and UI/UX design. • Architect and deploy multi-armed bandit (MAB) systems to dynamically select the best creative assets for show tiles and hero marquees. • Develop models to personalize carousel design types (e.g., square vs. poster), presentation styles, and even the ordering of attributes shown to the user. • Utilize NLP and LLMs to experiment with and optimize carousel titles and content descriptions based on user preferences and trending topics. • Design "always-on" experimentation pipelines that can shift traffic based on model confidence and reward signals (CTR, Playback Start). • Partner with Content Engineering to leverage visual embeddings and computer vision signals to understand why certain artwork performs better than others.

New York
$139K - $180K / year
Job Closed
Full TimeRemoteTeam 10,001+Since 1912H1B Sponsor

• Lead the Ad Pod, driving the technical roadmap for Pluto-specific ML use cases • Architect retrieval and ranking systems to recommend linear channels to users in real-time • Develop models that optimize channel scheduling and inform creation of algorithmic channels • Design loss functions and reward systems that weigh user commitment against business health • Lead vision for personalizing Electronic Programming Guide

New York
$234K - $260K / year