Role Description At Block, we believe product quality is foundational to great user experiences, and AI is transforming how we measure, understand, and improve that quality at scale. Our team builds the intelligence layer that evaluates system behavior across millions of real-world interactions, helping ensure our products are reliable, safe, and continuously improving. We’re looking for a Senior Machine Learning Engineer to lead the technical direction of next-generation quality systems powered by LLMs and AI agents. You’ll drive the architecture and strategy behind systems that evaluate product behavior, surface emerging issues, generate actionable insights, and enable teams across Block to make higher-confidence product decisions. In this role, you’ll operate across ambiguous, high-impact problem spaces and shape how quality is measured and operationalized across the organization. You’ll work across engineering, product, platform, and leadership teams to define long-term technical direction, establish scalable evaluation frameworks, and build systems that become foundational infrastructure for AI-driven product quality. You Will - Lead the technical strategy and architecture for AI-driven quality and evaluation systems used across products and teams. - Drive the development of scalable systems that use LLMs, agents, and behavioral signals to evaluate quality, detect regressions, and generate product insights. - Define long-term approaches for evaluation, measurement, and quality intelligence across complex product surfaces. - Translate ambiguous organizational needs into clear technical direction, roadmap priorities, and platform capabilities. - Influence engineering standards and best practices for building reliable, measurable, and trustworthy AI systems. - Lead complex cross-functional initiatives spanning product, infrastructure, data, and applied AI teams. - Mentor and level up engineers across the organization through technical leadership, design reviews, and systems thinking. - Identify leverage opportunities where AI systems can fundamentally improve how teams understand, debug, and improve product behavior. Qualifications - 5+ years of experience in software engineering, machine learning engineering or applied AI. - Deep experience designing and shipping large-scale AI/ML systems in production environments. - Strong expertise with LLMs, agents, evaluation systems, retrieval architectures, and modern AI infrastructure. - Proven ability to lead ambiguous, high-impact technical initiatives from concept through adoption across multiple teams. - Strong systems thinking and architectural judgment, with the ability to balance experimentation, scalability, and operational rigor. - Experience defining technical strategy and influencing roadmaps beyond your immediate team. - Excellent communication and cross-functional leadership skills, with the ability to align engineering, product, and organizational priorities. - A track record of creating leverage through platforms, frameworks, and systems that enable other engineers and teams to move faster and make better decisions. Benefits - Remote work - Medical insurance - Flexible time off - Retirement savings plans - Modern family planning Company Description Block, Inc. (NYSE: XYZ) builds technology to increase access to the global economy. Each of our brands unlocks different aspects of the economy for more people. - Square makes commerce and financial services accessible to sellers. - Cash App is the easy way to spend, send, and store money. - Afterpay is transforming the way customers manage their spending over time. - TIDAL is a music platform that empowers artists to thrive as entrepreneurs. - Bitkey is a simple self-custody wallet built for bitcoin. - Proto is a suite of bitcoin mining products and services.

• Lead the MLOps strategy on Databricks, defining architecture and standards; • Design and review CI/CD pipelines for ML models (training, packaging, deployment, rollback); • Define practices for model versioning and registry, feature stores, experiment reproducibility, and serving; • Establish end-to-end observability: performance, data/model drift, data quality, and business metrics; • Review PRs and critical architecture decisions; mentor the squad on the most complex topics; • Ensure governance, security, and cost control of the data and AI platform; • Participate in key ceremonies (planning, technical refinements, checkpoints), optimized for a part-time workload.

• Support in the development of AI systems. • Optimize Python code for data pipelines. • Perform data analysis and validation using SQL. • Assist with data modeling and automation.

Your Future Team - DevAI Atlassian's journey began with Jira, a tool designed to help developers track bugs and manage their work. Over the years, Atlassian has expanded its suite of productivity tools, yet developers remain at the heart of our focus. We are revitalizing our product lineup to better serve this core audience. Atlassian's ecosystem uniquely positions us to enhance every step of the developers' productivity cycle. With DevAI now established, we continue to evolve our AI-native SDLC solution, deeply integrating AI to redefine developer experiences. Our products include code reviewers, code generation, agentic engineering, spec-driven development, and more. Our vision is to transform software development, and we have ambitious plans to achieve this. What You'll Do As part of our team, you will play a crucial role in innovating the core intelligence solutions within our DevAI products. Your responsibilities will include (but not limited to) LLM integration, prompt engineering, and developing end-to-end AI features using cutting-edge technologies. You will collaborate closely with a diverse and highly skilled group of scientists and software engineers within our team, as well as with multiple partner teams across the company. Together, we are committed to delivering Atlassian's world-class developer AI products that will shape the future of software development. General Responsibilities - Strategic Leadership: Define and execute the long-term AI/ML strategy, ensuring alignment with product and business goals. - Team Building & Talent Development: Recruit, coach, and develop a high-performing team of engineers and scientists, fostering an inclusive and innovative culture. - Stakeholder Management: Partner with cross-functional leadership (product, engineering, data science) to drive product vision and execution. - Performance Management: Oversee team performance, providing coaching, feedback, and career growth opportunities for direct reports. - Technical Leadership & Mentoring: Provide technical guidance and mentorship to engineering teams, ensuring high standards of code quality and technical excellence. Daily Responsibilities - Project Oversight: Oversee the end-to-end lifecycle of key AI/ML initiatives, ensuring timely delivery and high-quality standards. - Resource Allocation: Balance team bandwidth across competing priorities, ensuring optimal resource distribution for high-impact projects. - Process Optimization: Establish and refine engineering processes to improve team velocity, code quality, and deployment standards. - Risk Management: Proactively identify technical and operational risks, implementing mitigation strategies to maintain team momentum. At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range. Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter. This role may also be eligible for benefits, bonuses, commissions, and equity. In The United States, we have three geographic pay zones. For this role, our current base pay ranges for new hires in each zone are: Zone A: $209,700 - $273,775 Zone B: $188,730 - $246,398 Zone C: $174,051 - $227,233 - Bachelor's or Master's degree (preferably a Computer Science degree or equivalent experience) - 10+ years of related industry experience in the data science domain, including 5+ years of direct people management experience. You should have a proven track record of building, mentoring, and scaling high-performing machine learning teams, with deep experience in organizational strategy, performance management, and developing engineering leaders. - Experience building and scaling machine learning models in business applications using large amounts of data - Ability to communicate and explain data science concepts to diverse audiences, craft a compelling story - Agile development mindset, appreciating the benefit of constant iteration and improvement It's great, but not required, if you have - Experience working in a consumer or B2C space for a SaaS product provider, or the enterprise/B2B space - Experience in developing deep learning-based models and working on LLM-related applications - Excelling in solving ambiguous and complex problems, being able to navigate through uncertain situations, breaking down complex challenges into manageable components and developing innovative solutions. Benefits & Perks Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits . About Atlassian At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together. We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines. To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them. To learn more about our culture and hiring process, visit go.atlassian.com/crh . In line with local law, identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.