Role Description A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases. - Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including: - Flight bookings and travel support - Financial services - Telecommunications and technical support - Contribute to the development of diverse and representative datasets used to assess conversational audio agents. - Evaluate model performance across a standardized set of qualitative and quantitative metrics. - Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow. Qualifications - Strong fluency in English - Strong verbal communication skills in a simulated customer support context - Spanish proficiency including fluency across all language skills: reading, listening, writing, and speaking. Requirements - Basic computer programming literacy, including: - Understanding of JSON structures - Familiarity with functions and methods - Ability to reason about structured data and simple logic - Technical communication clarity when handling support-style problem-solving - Access to a high-quality microphone to ensure clean, reliable audio input during evaluations - Comfort working with structured prompts, evaluation rubrics, and technical guidelines - Device capable of running audio recording software and opening large technical documentation Benefits - We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. - Final offer amounts may vary from the pay range listed above. - As a contractor, you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply. Company Description - Job title: Spanish Audio Specialist – AI Trainer - Employment type: Contract - Workplace type: Remote - Seniority level: Mid‑Senior Level

• Data Preparation - Prepare and maintain datasets for AI product evaluation, create annotation pipelines, build ground truth datasets, and support fine-tuning efforts with curated training examples • AI Model Evaluation - Test agent performance across model versions and prompt variations, build automated evaluation pipelines, and generate periodic reports that inform model selection and prompt engineering • Product Intelligence - Analyze user request patterns to identify high-demand use cases and capability gaps, cluster and classify large volumes of traces to find common themes and edge cases • User Analytics - Identify behaviors differentiating power users from casual users, analyze which user segments or industries drive highest engagement, and build statistical models to understand success vs failure drivers • Workflow Analytics - Optimize the first-time user funnel, correlate workflow usage patterns with customer retention, and identify power user behaviors across all workflows • Cost Optimization - Track quality metrics over time and alert on degradation, analyze token usage to identify cheaper model opportunities, and monitor latency across the agent pipeline (RAG, embeddings, generation) • Experimentation - Design and analyze statistically rigorous A/B tests for prompts and features, test new agent capabilities, and measure feature impact on user behavior and success rates

There are NO limits to your career: come shape the future and be part of a truly unique global culture at OutSystems! ### Join the AI Research & Solutions Group You're the engineer other engineers come to when the model won't converge, the paper's results don't reproduce, or the production system needs to be 10x faster. You've spent years in the trenches—training models, building datasets, debugging distributed failures—and you've developed deep intuition about what actually works. As a **Principal AI Engineer** in the AI Research & Solutions group, you'll work hands-on at least 3 days a week in the office in Menlo Park, serving as the senior technical leader for ML systems that power enterprise AI agents. We're building AI agents that reason, act, and recover across long-horizon workflows spanning hours of autonomous operation. As **Principal AI Engineer**, you'll define how we build these systems: the architectures, the training methods, the evaluation frameworks that separate demos from deployable products. This role is for someone who has **built the systems behind breakthroughs**—not the person who presents results, but the one who made them happen. ### What You'll Do ** Build Frontier AI Systems** - Define architectural patterns for training, deploying, and operating AI at scale—your decisions shape how the entire team approaches model development - Design agent systems that decompose tasks, invoke tools (compilers, debuggers, test runners), manage state, and recover from failures across multi-hour autonomous workflows - Architect RL pipelines with execution-based rewards (RLVR), process reward models, and self-improvement loops for code generation - Translate cutting-edge research into production: read papers, understand the math, build systems that work at scale * *Advance Evaluation Science** - Create evaluation frameworks that measure what actually matters—not benchmark leaderboards, but iteration efficiency, cost, reliability, and generalization to unseen codebases - Understand why SWE-Bench scores don't tell the whole story and define what does **Lead Technically** - Elevate the team: mentor on ML fundamentals, debugging techniques, and the craft of building reliable AI systems - Lead design reviews ensuring training pipelines are robust and models are production-ready - Align AI capabilities with product needs while maintaining technical integrity ### What You Bring - **Honest about uncertainty**—comfortable saying "I don't know, let me test it" # Why This Role? Autonomy to make real technical decisions. Resources to execute. A team building next-generation AI agents for enterprise applications on OutSystems—people who understand what it takes to make AI actually work. No explaining why training stability matters or why you need to look at the data. If you've been waiting for a role where your depth is valued and your judgment is trusted, this is it. The Longer Story: OutSystems enables enterprise teams to build AI-powered applications and agents that reduce manual work, streamline internal operations, and accelerate impact. A proven low-code foundation combined with agentic AI and AI app generation capabilities empowers teams to move up to 10x faster with the assurance of security, scalability, and governance built in. As the future becomes agentic, our customers need us now more than ever. AI has opened the door to extraordinary possibilities—but inside the enterprise, things are moving fast and feeling chaotic. Some early adopters are making progress in production, but for many, AI tools are sprawling without governance, data isn’t ready, and talent isn’t there yet. Enterprises are still drowning in application backlogs and struggling with legacy systems. But with the right platform, AI doesn’t have to add to the chaos. It can become the breakthrough that brings clarity—and drives real, enterprise-wide impact. At OutSystems, we’ve built that platform, providing the tools necessary for enterprises to overcome these hurdles. We are looking for passionate, talented, and motivated people to join us in helping our customers build, deploy, and scale apps and agents—fast, helping them accelerate innovation while enabling secure, governed human-AI collaboration. OutSystems is a truly global company, with more than 850,000 developer community members, 1,700 employees, more than 500 partners, and thousands of active customers in over 75 countries and across 21 industries. Founded in 2001, OutSystems has offices in the United States, United Kingdom, the Netherlands, Portugal, Germany, the UAE, Japan, Hong Kong, Malaysia, Australia, India, and Singapore, and of course has a thriving, worldwide community of remote employees. Amongst our customers are some of the world's most recognizable brands across diverse industries—brands like Toyota, Heineken, Bosch, KeyBank, and UCLA. These customers are the reason we have a 4.6 star rating on G2. Their success is ours, and their stories demonstrate tangible ROI and transformational impact. We are a 9x Gartner Magic Quadrant Leader for Low-Code Application Platforms and a multi-year leader in the Forrester Wave. We’re recognized not just as leaders but as visionaries with a strong ability to execute, now extending our leadership into the AI and agentic application development arena. Working at OutSystems Our goal is to ensure that OutSystems is a place for bright, happy, and motivated people who share a common purpose and take pride in doing excellent work to pursue our vision of providing the AI-powered low-code development platform enterprise leaders trust to build, secure, and evolve their business applications, agents, and core systems. Our culture is focused on our core values of trust, customer success, innovation, and alignment. Our team members operate with transparency, integrity, and accountability, define success through the lens of the outcomes we deliver for our customers, push the boundaries with excellence, and work together toward our shared vision to deliver on what matters most. What do we have to offer you? A company that is always growing, changing, and innovating. We challenge each other to innovate in our products, in our team, and how we use our own technology. And we give our teams space to be proactive and creative. Real career opportunities. We care about growth and development. Yes, vertical career progression is a possibility, but it's not the only one. From lateral moves and joining different teams to mastering specialized skills, we support your growth no matter what your goals are. Work colleagues that are as smart, hard-working, and driven as you. We act as one global OutSystems team, taking ownership and working together toward a shared vision. Disrupting the status quo is in our DNA. In fact, it’s why our company exists. We ask “why” a lot. It helps us connect our individual work to the bigger picture and sometimes even uncover a better way. Are you ready for the next step in your career? Then we’d love to hear from you! OutSystems nurtures an inclusive culture of diversity, where everyone feels empowered to be their authentic self and perform at their best. A company that embraces the creativity and innovation that comes through diverse perspectives. We are committed to creating a team that reflects society through inclusive programs and initiatives and are proud to be an equal opportunity employer. All qualified applicants receive equal consideration regardless of race, place of origin, color, age, marital status, religion, sex, sexual orientation, gender expression or identity, protected veteran status, disability status or any other status protected by law.

Company Description At Brightspeed, we are reimagining how people live, work, play and connect by providing fast, reliable internet connections and an awesome customer experience in twenty states throughout the Midwest and South. Backed by funds managed by Apollo Global Management, our vision is to accelerate the upgrade of copper to fiber optic technologies, bringing faster and more reliable internet service to many rural markets traditionally underserved by broadband providers, while delivering best-in-class customer experience. Be a part of the team that will make this vision a reality….designing and building a world class fiber network and creating a customer experience second to none. Check us out on the web! Job Description Brightspeed is looking for a Forecaster to join our team! In the Forecaster position, you will be responsible for managing the work streams and the resources that affect how appointments are being offered. The forecast system creates and maintains forecast models for the Network workforce, incorporating business intelligence and forecast information gathered from multiple sources. The Forecast Team is the integration point into the Field Network, supporting Field Management in all Regions. Implementation of the Forecast System, Detail forecast modeling is the responsibility of this position. This position leads the dialogue for their respective markets and products team. As a Forecaster, Your Responsibilities Will Include: Creating statistical forecast in the Forecasting Tool which incorporates resource information to allow the company to predict Employee resources and provide its supply chain with information to meet customer demand. Gathering, analyzing and validating data Executing statistical modeling and data Reviewing statistical forecast models and plans Achieving consensus for operational demand forecasts by facilitating a collaborative planning process and improving relationships among planners and Field Management to better guide the company expectations and results while managing expenses Applying error analysis techniques to improve forecasting Summarizing aggregate statistical forecasts Recommending adjustments for operational forecasts Preparing relevant material to facilitate research and discussion Providing input to volume planning (Latest Estimates annual process) Facilitating and managing demand planning customer meetings Achieving consensus with the business side and the demand chain Maintaining demand planning system and Forecast Tool Entering and modifying data and ensuring data is correct Monitoring trends in forecast error Preparing and maintaining relevant reports pertaining to demand planning process Refining systems and methods to continually improve forecasts to better anticipate customer needs Qualifications We offer competitive compensation and comprehensive benefits. Our benefits and paid time off programs reflect our underlying belief in promoting overall wellness through physical, emotional and financial health. Brightspeed offers a comprehensive benefit program, including competitive medical, dental, vision, and life insurance; an employee assistance program; a 401K plan with company match and a host of voluntary benefits. Inclusion and belonging are at the center of our grounding belief in Being Real . When we bring our authentic selves to work, everyone is better as a result. A diverse team helps us be fierce advocates for more accessible, inclusive and high-quality internet, because we believe doing so promotes equity in the communities we serve. Brightspeed is an Equal Opportunity Employer that is committed to inclusion of all qualified individuals, including individuals with a disability/veterans. If you require reasonable accommodation to complete a job application or to otherwise participate in the hiring process, please contact taaccommodationrequests@brightspeed.com to initiate the accommodations process. For all applicants, please take a moment to review our Privacy Notices: Brightspeed’s Privacy Notice for California Residents Brightspeed’s Privacy Notice