Senior AI Product Engineer

Location

Worldwide

Posted

2 days ago

Salary

0

Seniority

Senior

Job Description

Senior AI Product Engineer

Progress Partners

Role Description We're looking for a Senior AI Product Engineer to own the continuous improvement of our customer-facing AI products, making them more accurate, reliable, cost-efficient, and genuinely useful to the people who rely on them every day. This isn't a prompt-writing job; it's about building the structured loop of evaluation, experimentation, and analytics that turns AI from a feature into a measurable product advantage. You'll work at the intersection of Product, Growth, and Engineering, with real influence over how AI behavior gets measured, improved, and shipped. What You’ll Do - Own the end-to-end quality of our AI-powered product experiences, improving response usefulness, consistency, and reliability in ways users actually notice. - Build evaluation frameworks and repeatable test sets so we can measure AI quality objectively, not anecdotally. - Design and run experiments on prompts, context strategies, and model settings, connecting every change to activation, conversion, retention, or satisfaction metrics. - Monitor and reduce AI-related costs (tokens, latency, model choice, retrieval) without compromising the user experience. - Translate AI failure patterns, hallucinations, inconsistent outputs, weak reasoning, into clear, prioritized fixes for Product and Engineering. - Help Product, Growth, and Engineering teams understand where AI changes create real user and business impact. Qualifications - 5+ years in software engineering, AI product engineering, ML engineering, or a related technical role, plus 2+ years hands-on with LLMs, prompt engineering, or applied AI systems. - Proven experience improving AI features post-launch through analytics, experimentation, and structured evaluation, not just initial prompt design. - Strong grasp of product analytics, funnel metrics, and how to connect AI behavior to business outcomes. - Ability to diagnose whether an AI quality issue stems from prompts, context, model limitations, UX, or data, and to fix the right layer. - Strong written communication and the ability to work autonomously in a remote, async environment. - Comfort working closely with Product, Growth, Design, Engineering, QA, and Analytics. - Comfort with ownership, transparency, and a results-driven mindset. Nice to Have - Experience with A/B testing frameworks, AI observability tools, or custom evaluation pipelines. - Hands-on work with OpenAI, Anthropic, Gemini, AWS Bedrock, or similar LLM providers. - Familiarity with RAG, embeddings, semantic search, or tool-calling architectures. - Background in chatbot, assistant, content generation, or recommendation products. What We Offer - Remote-first: work from anywhere in the world, no relocation required. - Flexible hours: we measure outcomes, not time at a desk. - Unlimited PTO: take the time you need to rest, recharge, and do your best work. - Learning & development budget: courses, books, conferences, certifications, whatever helps you grow. - Performance-based compensation: your impact directly shapes your pay and career trajectory. - A small, senior, collaborative team where your work is visible and your decisions matter. - The chance to build products used by millions of people across 160+ countries. Equal Opportunity Progress Partners is an equal opportunity employer, and we’re serious about building a diverse, inclusive team. We welcome applications from people of all genders, gender identities and expressions, sexual orientations, ages, ethnicities, nationalities, religions, disabilities, neurotypes, family situations, socioeconomic backgrounds, and life experiences. We hire on skills, experience, potential, and values fit, never on protected characteristics. If you need accommodations during the application or interview process, just let us know.

Related Categories

Related Job Pages

More Solutions Engineer Jobs

Full TimeRemoteTeam 51-200Since 2020H1B Sponsor

Role Description Thunder's Solution Architect is responsible for collaborating with our customers' technology and business stakeholders to develop a scalable Salesforce architecture, vision and strategy that enables best-in-class business outcomes. Our Solution Architects function as a liaison between client and the Thunder team, translating client requirements into the architecture for key client needs. The SA understands the scope of the project and validates the correct resources for the project, maps business functional requirements to system/technical requirements, and ensures alignment of planning and solutions with client’s business goals. Ideal candidates will demonstrate previous consulting experience in Salesforce Field Service and Service Cloud, complying with best practices related to solution design, documentation, and guidelines that lead to the identification, selection, development and use of solutions and applications. SA will also serve as a Subject Matter Expert, partnering with sales and business development teams in the process of client discovery and sales engineering, as well as to accurately estimate the technical level of effort required for scope of work sold. Responsibilities - Responsible for Salesforce Field Service and Service Cloud solution design and implementation - Leading business and technology analysis and provide CRM domain expertise - Leading client architecture initiatives from inception to completion, acting as a technical subject matter expert while providing expertise to business users and challenging point of views - Partnering with Sales team in the process of client discovery to accurately estimate the technical level of effort for scope of work sold - Responsible for combined on+offshore team project delivery success and owning the overall health of on+offshore project team - Championing the adoption of reusable architecture assets to improve efficiency - Producing documentation to aid in the understanding of existing architecture solutions - Owning the overall execution of implementation deliverables and QA Qualifications - 4-6+ years of consulting experience within the Salesforce ecosystem - 2-3+ years of solution design experience with Salesforce Field Service and Service Cloud - Foundational understanding of Field Service Object Model, including Work Orders and Service Appointments - Experience with Field Service scheduling and optimization logic/principles (Preferred) - Significant experience across Salesforce suite of products including Sales Cloud, Marketing Cloud, and/or Experience Cloud (Preferred) - Experience solutioning on the Salesforce platform, particularly for a variety of clients (including enterprise) - Comprehensive knowledge of software, application, and platforms, and working knowledge of business modeling, governance and operations - Strong business processes, process documentation, and process improvement skills - Active Salesforce certifications and willingness to achieve additional certifications on emerging technologies as required per role Equal Opportunity Statement Research shows that women and people from underrepresented groups often apply to jobs only if they meet 100% of the qualifications. We recognize that it is highly unlikely that someone meets 100% of the qualifications for a role. If most of this job description describes you, then we encourage you to please apply for this role. Thunder is proud to be an Equal Opportunity employer, and is deeply committed to building and supporting our diverse team through inclusive, equitable hiring practices. Recruitment Policy Thunder does not accept unsolicited resumes from recruitment agencies. All resumes submitted by recruitment agencies to any employee via email, the Internet (including LinkedIn), or directly without a fully-executed search agreement will be deemed the sole property of Thunder, and no fee will be paid in the event the candidate is hired.

United States
Eastern Communications Ltd. logo

Staff Solutions Engineer

Eastern Communications Ltd.

Mission Critical Communications Technology, Services, and Infrastructure

Full TimeRemoteTeam 201-500Since 1976H1B No Sponsor

• Prepare quotations for complex radio communications system based on customer and partner requirements, utilizing expertise in system design, product knowledge, and RF propagation tools; 35%. • Serve as the technical lead in responding to Requests for Proposals (RFPs), including reviewing RFP requirements, developing preliminary system designs, preparing technical documentation, creating system drawings, addressing detailed technical specifications, and compiling equipment and services pricing; 41%. • Support capture management for complex and strategic RFPs by contributing to Blue Sheet activities and pre-RFP engagement; 3%. • Conduct comprehensive industry and market research on emerging products and technologies to develop subject matter expertise, with a primary focus on validating solutions that support organizational partnership and business development initiatives; 3%. • Provide technical sales training to Partners and Sales Teams on new products and engineering tools; 3%. • Conduct on-site inspections at customer locations to assess existing radio and dispatch communication systems in preparation for future upgrades; 5%. • Evaluate all components of the communications infrastructure, including generators, shelters, grounding systems, towers, DC power supplies, and other related site development elements; 5%. • Serve as a technical subject matter expert and industry representative by delivering presentations on various technical topics at partner webinars, industry trade shows, partner meetings, and customer events; 3%.

New York
$127.2K - $140K / year
Full TimeRemoteTeam 51-200H1B No Sponsor

• Partner with Account Executives to support strategic sales opportunities. • Lead and participate in customer discovery sessions. • Gather, document, and validate business, clinical, operational, and technical requirements. • Develop solution strategies aligned with customer goals and platform capabilities. • Serve as a trusted advisor throughout the evaluation process. • Deliver compelling, tailored demonstrations to executive, clinical, operational, and technical audiences. • Build and maintain demonstration environments that reflect real-world customer scenarios. • Translate customer requirements into recommended solution approaches. • Support integration, interoperability, API, data exchange, and technical architecture discussions as needed. • Assist in completing responses to Requests for Proposal (RFPs), Requests for Information (RFIs), and security questionnaires. • Share market intelligence and customer feedback with Senior Director of Solutions Consulting.

India
Full TimeRemoteTeam 10,001+Since 1980H1B Sponsor

• Provides presales solution architecture services across materially significant, strategically important clients and client groups. • Leads in the development of complex, tailored solutions, ensuring alignment with client needs and Unisys offerings, often incorporating emerging technologies. • Develops and delivers high-level presentations and demos, articulating the value of proposed solutions to senior-level managers and decision-makers. • Works with sales, product development and engineering teams to align proposed solutions with business objectives, ensuring technical feasibility and optimal client outcomes. • Oversees and contributes to preparation of technical responses for RFPs and RFIs, ensuring competitive and technically sound submissions. • Evaluates potential risks, ensuring that solutions comply with operational standards, security protocols and applicable regulations. • Fosters long-term client relations, providing trusted advice and counsel from a technical and operational perspective.

Pennsylvania