Job Closed
This listing is no longer active.
The pulse that empowers your tech team
Applied AI Engineer – Agent Reliability
Location
Brazil
Posted
25 days ago
Salary
0
Seniority
Senior
Job Description
Applied AI Engineer – Agent Reliability
PulseRise Technologies
• Instrument agents with trace-level observability (Langfuse or equivalent) • Build evaluation datasets from production traffic • Design and operate scoring pipelines (quality + robustness scoring) • Stand up and operate Braintrust or equivalent evaluation framework • Build feedback loops from eval → prompt → architecture → re-evaluation • Implement DSPy / DPO optimization as system matures • Partner with technical leadership on reliability-sensitive architecture decisions • Own dev → test → deploy → on-call sustain for your workstream
Job Requirements
- Real production experience with non-deterministic LLM systems (NOT side projects)
- Experience building or operating evaluation pipelines
- Strong Python backend (FastAPI / Django / Celery)
- Observability experience (Langfuse / Grafana / Loki or equivalent)
- Experience owning systems end-to-end
- Async communication skills + fluent English
- Based in LATAM
Related Guides
Related Job Pages
More AI Engineer Jobs
AI Developer
WSPWSP USA is the U.S. operating company of WSP, one of the world's leading engineering and professional services firms. Dedicated to serving local communities. Designs lasting solutions in the buildings, transportation, energy, water, and environment markets. More than 15,000 employees in over 300 offices across the U.S.
Role Description As an AI Developer (LLM & Agentic Systems), you will design and develop AI-enabled applications and intelligent systems used in client-facing projects, supporting decision-making across mining, resources, infrastructure, and environmental domains. This role can be based anywhere in Canada and plays a key part in advancing our AI-enabled platforms, internal tooling, and next-generation data solutions. - Design, build, and maintain scalable full-stack applications that integrate advanced AI and data capabilities. - Develop backend APIs and cloud-native components that support scalable data and analytics workflows. - Integrate LLMs, agentic workflows, and NLP techniques (e.g., entity recognition and entity resolution) into production-ready systems. - Contribute to the design and evolution of knowledge-based and data-driven platforms. - Develop and integrate data pipelines and knowledge-driven components (e.g., structured data, semantic layers, or knowledge graphs) into applications. - Collaborate closely with analytics, data science, knowledge engineering, and digital product teams. - Work directly with internal teams and clients to translate requirements into scalable, production-ready solutions. - Implement secure, maintainable, and testable code aligned with industry best practices. - Support CI/CD, Git workflows, and DevOps automation. Qualifications - Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline. - 5+ years of professional software development experience, including 2+ years leading the design, deployment, and scaling of LLM-based or agentic AI systems in production environments. - Demonstrated experience designing end-to-end AI architectures, including data ingestion, retrieval, reasoning layers, and user-facing applications. - Strong experience with LLM workflows, including prompt engineering, evaluation strategies, agent orchestration, and tool integration. - Hands-on experience with embeddings, vector search, and RAG pipelines, including performance optimization and retrieval quality improvements. - Proven ability to design and build scalable backend systems and APIs (Python – FastAPI preferred, or Node.js), including microservices architectures. - Experience integrating structured and unstructured data into scalable AI applications. - Experience applying NLP techniques (e.g., entity extraction, entity resolution) in real-world applications. - Strong experience with cloud-native development (Azure preferred), including deployment, monitoring, and cost/performance optimization. - Experience with DevOps practices, including CI/CD pipelines, Git workflows, and multi-environment deployments (dev, UAT, production). - Nice to have: Experience with knowledge graphs and graph query languages (e.g., SPARQL, Cypher), microservices, Docker/Kubernetes, ETL pipelines, or engineering-heavy data environments. Benefits - Proudly Canadian – we are a Top 100 Employer in Canada for 2026. - A global community of brilliant minds – your next idea, mentor, or opportunity is always within reach. - Limitless opportunities start here – we help you tailor your role to match your ambition. - Flexible work, real balance – we recognize the importance of balance in our lives. Compensation - AB, BC, NT, NU, SK & YT: $93,700 – $124,200 - MB & ON: $85,500 – $117,800 - NB, NL, NS, PEI & QC: $84,700 – $112,400
Senior Forward Deployed AI Engineer
SmartsheetFounded in 2005, Smartsheet offers collaborative work management and process automation to empower greater enterprise productivity. A leading cloud-based platform for work executio
• Lead complex, multi-system AI deployments end-to-end scope, architect, build, validate, and manage the customer relationship throughout. • Own the AI workshop program for your pod, customize modules per customer, lead technical sessions, translate outputs into production requirements, evolve content from field learning. • Architect multi-agent solutions selecting the right coordination pattern for each customer’s workflow characteristics and compliance requirements. • Design client-specific and industry-specific MCP resource packs that serve personalized intelligence from the server so every connected AI surface gets smarter for that customer automatically. • Own Deployment Kit quality for your pod. If a kit is not documented well enough for a solutions consultant with no engineering background to follow, it isn’t done. • Lead Solutions Enablement Sprints: transfer AI deployment patterns to solutions consultants and partners with training materials and certification criteria. • Drive the intelligence loop: author strategic memos, present field findings weekly, contribute Agent Bricks and Skills, file RFCs for platform improvements. • Mentor junior FDEs on customer engagements, code reviews, and Deployment Kit quality.
STEAM Lab Instructor
Boys' Club of New YorkThe Boys' Club of New York is a non-profit organization that provides educational programs to assist its members attain higher personal and academic achievement
Manage the STEAM lab for small groups, engage students with relevant lessons, develop project-based learning activities, and collaborate with the Education Director to enhance curricula and activities.
Senior - Staff Product Engineer, AI
Linear Orbit, Inc.Linear Orbit, Inc., or simply Linear, is a product development software application designed to streamline operations through enhanced efficiency, transparent p
Title: Senior - Staff Product Engineer, AI Location: North America Department: Product Job Description: At Linear, we're building the product development system for teams and agents. AI is fundamentally changing how software gets built, and we’re shaping the tools this new era requires. Founded in 2019, Linear has become the platform of choice for more than 25,000 companies (including OpenAI, Coinbase, and Ramp) to plan, build, and ship their products. Today, our team is distributed across North America and Europe, and we’re continuing to grow internationally. What unites us is relentless focus, fast execution, and a deep care for software craftsmanship. We’re looking for experienced engineers who have shipped applied AI systems to production and want to define what the agent-native future looks like. We are building intelligence into the core of Linear, enabling the product to orchestrate coding, proactively move work forward, and power-up every software team. You’ll work closely with product and design to transform foundation models into structured, reliable workflows embedded deeply in the core of Linear. We care deeply about keeping Linear fast, intuitive, and opinionated—AI is no exception. Location & work mode Linear is a remote-first company. This role is open to candidates based in the North America. You can work from anywhere within this region. We value deep focus and async collaboration, with intentional moments to connect in person through team off-sites, optional co-working, and occasional travel. What you'll do - Build AI-powered product features that feel native, fast, and delightful to use - Work with product and design to prototype and iterate on intelligent workflows and user interactions - Design backend services to power natural language interfaces, smart suggestions, agentic workloads, and more - Optimize prompts, fine-tune model behavior, and evaluate performance - Help to guide our agent platform, allowing third parties to bring agents into the core Linear experience as teammates. - Contribute to the architecture for AI-integration infrastructure that’s reliable and privacy-aware What we're looking for - 5+ years of experience building customer-facing products at a high-quality software company - Strong React and TypeScript fundamentals, with experience across the full stack (Browser technologies, Node, GraphQL, PostgreSQL) - Track record of driving complex, end-to-end features (not just incremental improvements and refactors) with visible impact on the product - Product sensibility: you care about UX, speed, and polish, and you push back when something doesn't feel right - Comfortable working without heavy PM overhead; you can help to shape the problem, not just implement a solution - High ownership mentality: self-directed, full-lifecycle builder who takes a feature from idea to shipped - Thrives in a remote, async-first environment with a lean, high-output team - Experience at a startup or a company with a genuinely high engineering bar Our tech This stack reflects the systems we build and operate. You’re not expected to have experience with everything listed, but you should be excited to work close to product, performance, and real-world scale. - Agentic workload system utilizing temporal, operating at production scale - Proprietary websocket data sync framework built for speed and offline support - React, MobX, styled-components on the frontend - Extensive, widely used, GraphQL API and SDK - Node, Postgres, Temporal, and Redis in the backend - Hosted on Google Cloud with k8s - GitHub, Slack, Notion What we offer We're a small, focused team that cares deeply about the quality of our work and the people we do it with. Here's what you can expect: - Competitive salary and equity - Employee-friendly equity terms including early exercise in the US and extended exercise windows - Daily meal and coffee stipend on every workday - Paid co-working space or desk - Health coverage (based on country requirements) - 5 weeks paid vacation, plus local statutory holidays - 4 months paid parental leave - Paid month off after 4 years & every 2 years thereafter - Regular team events and off-sites - Remote-first with no required commute Learn how we think and work - Read Me a story about our mission - Our hiring process: How we hire at Linear - How we work: Designing remote work at Linear - Why and how we do work trials Linear blog post - Crafting quality that endures Config keynote by our Co-founder & CEO, Karri Saarinen - How we structure our product teams talk by our Head of Product, Nan Yu, at Config 2024 - Scaling our real-time sync engine talk by our cofounder, Tuomas Artman, at Linear's 2023 offsite - First Round Capital: The Unsung Ingredient: Taste Linear is an equal opportunity employer. We do not discriminate based on race, color, religion, gender identity or expression, sexual orientation, national origin, age, disability, veteran status, or any other protected characteristic under applicable law.

