Job Closed

This listing is no longer active.

Canva logo
Canva

Design anything. Publish anywhere.

Machine Learning Engineering Manager – Evaluations

Engineering ManagerEngineering ManagerFull TimeRemoteSeniorTeam 1,001-5,000Since 2013H1B SponsorCompany SiteLinkedIn

Location

United Kingdom

Posted

101 days ago

Salary

0

Seniority

Senior

Bachelor DegreeEnglish

Job Description

Machine Learning Engineering Manager – Evaluations

Canva

• You will lead and grow a team of high-performing Machine Learning Engineers and Research Scientists (EU based) who are advancing the future of AI at scale. • Your focus will be on setting strategic technical direction, coaching others to deliver impactful engineering solutions, and ensuring the deployment of robust, scalable ML systems into production. • You'll champion both engineering excellence and measurable impact, bridging foundational model capabilities with real-world deployment across Canva's platform. • Coaching and mentoring a high-performing team of Machine Learning Engineers and Research Scientists. • Owning the evaluation infrastructure - Design, build, and maintain robust evaluation systems, quality metrics, safety monitoring, red-teaming, competitive benchmarking - to guarantee enterprise readiness and user delight at scale. • Building automated metrics that reliably predict human aesthetic judgment across dimensions like visual hierarchy, layout coherence, typography, and brand alignment. • Advising on human evaluation pipelines and closing the loop between user signals and model improvements. • Setting technical strategy in alignment with Canva's AI and product goals. • Guiding engineering direction across model deployment, evaluation infrastructure, and production systems. • Partnering cross-functionally to ensure ML capabilities translate into reliable product impact.

Job Requirements

  • Have led machine learning engineering teams, with a strong track record of coaching and delivering production systems.
  • Possess expert knowledge in deploying and scaling generative models (Diffusion, GANs, VAEs, LLMs) in production environments with a strong focus on visual models (image, video, design).
  • Bring hands-on experience building ML infrastructure, evaluation pipelines, and monitoring systems at scale.
  • Excel at creating data-driven evaluation methodologies, turning user analytics and production metrics into clear, actionable insights.
  • Have strong systems design skills and experience with MLOps, model serving, and production reliability.
  • Have experience with visual quality assessment, aesthetic modelling, or human preference learning – bonus if you've tackled the gap between automated metrics and human raters.
  • Understand design principles (hierarchy, balance, typography, colour theory) well enough to operationalise them as measurable signals.
  • Thrive in collaborative environments and communicate clearly with technical and non-technical audiences.
  • Stay current with both SOTA research trends and engineering best practices, energised by continuous learning.

Benefits

  • Equity packages - we want our success to be yours too
  • Inclusive parental leave policy that supports all parents & carers
  • An annual Vibe & Thrive allowance to support your wellbeing, social connection, home office setup & more
  • Flexible leave options that empower you to be a force for good, take time to recharge and supports you personally

Related Categories

Related Job Pages

More Engineering Manager Jobs

Role Description The Technical Service Manager (TSM) will develop and maintain relationships with potential and existing clients within the technical and manufacturing fields. Identify opportunities to mentor existing workforce while developing and implementing strategies for growth and best business practices within assigned location and/or department. Position is also responsible for completing technical jobs and duties as business needs dictate. - Responsible for day-to-day operations of assigned location and/or department. - Provide solutions to local business topics (Customer concerns, employee question/concerns, facility issues, etc.). - Responsible for hiring and training for direct reports. - Conduct interviews, complete job reviews, set and review professional development goals for direct reports. - Mentor and coach team of technicians; Audit performance quality and build training plans for direct reports. - Ensure staff is motivated and productive. - Schedule work of local team and coordinate schedules for larger jobs with other managers. - Apply industry knowledge to offer technical/practical options to both internal and external customers. - Prepare and review quotes; perform job walks as required; review test reports; audit field work for quality. - Cultivate and maintain customer relationships with internal customers, external customers, and vendors. - Conduct client communication in a highly customer service-oriented manner. - Responsible for reviewing jobs to ensure the job meets or exceeds profitability goals. - Work with VP, GM and/or GM to ensure continuous improvement strategic business initiatives are developed and implemented. - Prepare variety of reports as assigned. - Work with HSE to develop effective safety records and practices to minimize the Company’s exposure to potential risks. - Work may require flexible hours, weekends, holidays, and night work to work, coordinate and/or communicate location business needs. - All work and decisions shall be conducted in strict compliance of all regulatory law. - Observe all safety rules and Best Practices; Follow all company policies and procedures. - Maintain NETA certification and be willing to test up to the next level-Testing Division. - Other duties as assigned. Qualifications - Associate degree in related field or experience equivalency and a minimum of 5 years related experience. - Knowledge of various industry standards such as: NETA, NEC, OSHA and NFPA. - Prefer experience with most of the following or similar: MCC’s, Breakers, relay testing, etc. or training from the military (Army Prime Power, Air Force Electrical Power Production, NAVY or another related program). - Thorough understanding of heavy industrial, utility, large commercial, renewable energy and ability to troubleshoot complex business issues. - Must be able to work safely and adhere to all electrical safety procedures. - Work may require flexible hours, weekends and holidays. Must be available for out-of-town work. - Proven leadership and mentoring skills. - Strong communication (written and oral). - Able to meet deadlines and handle multiple tasks. - Strong oral and written communication skills. - Able to work with various people throughout the organization-Customer Focused. - Focus on accuracy and efficiencies. - For positions that utilize a company vehicle, will be required to have a valid driver’s license. Benefits - Full benefits including medical, dental, vision, company-paid life insurance. - Employee Ownership Plan. - Matching 401k. - Paid time off. - Paid Holidays. - Milestone bonus. Additional Information - Travel: Up to 85% travel. - Type: Full-time. - Location: Nationwide. - Compensation: $55.00-$60.00 an hour plus eligible for overtime. - Relocation: Not available for this role. - Physical Demands: Office Duties; Lifting a maximum of 50lbs on a daily, crawling, climbing, standing for long periods of time and working in non-ideal conditions. Application Details The position will stay open until filled - seeking one FTE. Apply via job postings on job boards or from the company website. RESA Power is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, or veteran status.

United States
$55 - $60 / year
Job Closed
1Password logo

Engineering Manager, Partnerships Engineering

1Password

Productive businesses use 1Password to secure employees at scale.

OtherRemoteTeam 501-1,000Since 2009H1B Sponsor

• Serve as the primary engineering owner for external partnership integrations, from discovery through GA launch. • Act as the technical counterpart in partnership discussions, validating feasibility, scope, and tradeoffs. • Support deal progression when needed through design proposals, architecture reviews, and technical assessments. • Establish and own an external integrations program that tracks work reliably across the full partnership lifecycle. • Define processes, roles, and execution models that enable multiple integrations to run in parallel without heroics. • Guide and support hands‑on integration work with partners, including direct consultation and building or extending first‑party components. • Ensure integrations are well‑designed, maintainable, and aligned with platform, security, and product standards. • Own engineering documentation that supports Strategic Partnerships, external partners, and internal engineers throughout integration work. • Identify recurring integration patterns and turn them into reusable approaches.

United States
$190K - $258K / year
PathAI logo

Associate Director, MLOps Engineering

PathAI

Improving patient outcomes with AI-powered pathology.

OtherRemoteTeam 501-1,000Since 2016H1B Sponsor

Who We Are PathAI's mission is to improve patient outcomes with AI-powered pathology. Our platform promises substantial improvements to the accuracy of diagnosis and the efficacy of treatment of diseases like cancer, leveraging modern approaches in machine learning and artificial intelligence. We have a track record of success in deploying AI algorithms for histopathology in translational research, pathology labs and clinical trials.  Rigorous science and careful analysis is critical to the success of everything we do. Our team, composed of diverse employees with a wide range of backgrounds and experiences, is passionate about solving challenging problems and making a huge impact on patient outcomes. Where You Fit As the Asspcoate Director, MLOps Lead, you will lead the team responsible for the backbone of our AI/ML Stack: the infrastructure that bridges ML research and massive-scale production. Your primary directive is to evolve our stack to meet the next scale of needs in large scale ML training & inference workloads. You’re someone who enjoys designing and building for reliability, relishes collaboration and technical challenges, and takes pride in making things better – without taking yourself too seriously. Our technical space is broad: high-scale AI training & inference workloads, cloud infrastructure, Kubernetes, observability, distributed systems, and a bit of everything in between. What You’ll Do This role is critical for driving the scalability and efficiency of our Machine Learning Operations platform with high-impact & high growth strategic initiatives. Vision and Roadmap: Develop and execute the long term vision & roadmap for MLOPs team to support ML development and deployment needs across the business units. Successfully manage the tension between short-term tactical deliveries and long-term architectural transformation for future growth. Team Management: Lead and mentor a team of 6-7+ high-performing engineers. Strategically allocate resources to manage support for existing services while executing key strategic initiatives. Cross-Functional Collaboration: Partner with leaders across machine learning, data science, product engineering, and infrastructure to proactively identify pain points, address bottlenecks, and facilitate the deployment of new solutions. Foundation Model Readiness: Architect the compute and storage pipelines required for ML Engineers to manage millions of slides and complex derived artifacts without data fragmentation or synchronization latency. Inference Modernization: Modernize the AI Product inference stack to support 5-10x growth of AI runs across global deployments. System Observability: Collaborate with Site Reliability Engineering (SRE) to establish comprehensive metrics covering compute under-utilization, network bottlenecks, and granular cost and turn-around-time attribution. Technology Refresh: Conduct "Build vs. Buy" assessments, leading "Stack Refresh" audits to benchmark our proprietary tools against best-in-class commercial and open-source alternatives to meet our future needs. What You Bring

Indiana + 1 moreAll locations: Indiana | New York

Company Description We are a stealth mode startup in the greater Boston area developing eVTOL passenger vehicles with a novel vertical flight propulsion/guidance system for deployment in the burgeoning urban air mobility space. Our innovative startup seeks driven, high performance, high energy achievers who can work in a multidisciplinary team to build a groundbreaking eVTOL platform that will be the foundation for a range of high performance ultra quiet vertical flight systems. Job Description Don't see your perfect role on our careers page? We want you to hear from you, and understand your superpower and what types of problems you like to solve. Please submit your resume to this posting and share in an email or cover letter introducing yourself, a few career milestones, and why the eVTOL and urban air mobility industry is exciting to you. Qualifications

Massachusetts