LawPro.ai logo
LawPro.ai

Transforming Legal Workflows with AI – Built by Lawyers, for Lawyers.

AI Engineer

AI EngineerMachine Learning EngineerFull TimeRemoteSeniorTeam 11-50Since 2023H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

3 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishAWSCloudGoogle Cloud Platform

Job Description

AI Engineer

LawPro.ai

• Continuous LLM Evaluation: Design and operate a systematic, ongoing process to evaluate new and emerging LLMs across accuracy, relevancy, speed, and cost — continuously benchmarking them against the specific tasks in our orchestration pipeline proactively optimizing outcomes. • Eval Framework Development: Build and maintain rigorous evaluation frameworks (Evals) to measure LLM output accuracy, relevance, faithfulness, and speed with a specific focus on reducing hallucinations in medical record summarization and legal document analysis. • Proactive Model Transition Planning: Monitor the LLM landscape across providers to identify deprecation timelines and suitable replacement models — and own the full execution of those transitions, including integrating new models into the production pipeline and maintaining necessary changes to account for model behavior. • AI Pipeline Optimization: Directly implement optimizations to LLM-based orchestration pipelines for document understanding, medical record summarization, case chronology generation, and drafting support — owning code changes, deployments, and production validation from start to finish. • Cross-Functional Collaboration: Partner with product and GTM stakeholders to communicate model evaluation findings — then lead the technical implementation yourself rather than delegating execution to a separate engineering team. • End-to-End Implementation Ownership: Take full responsibility for shipping model changes into production — writing the integration code, managing deployments, running validation tests, and ensuring a clean rollout. • Operational Monitoring: Implement monitoring and observability for model performance in production, benchmarking outputs and cost, detecting drift with ongoing and continuous reporting to management. • Documentation: Maintain thorough documentation of evaluation methodologies, model comparison results, transition decisions, and runbooks for the systems you own.

Job Requirements

  • 5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying large language models in production environments — including building and deploying the models to cloud (AWS or GCP) infrastructure at scale.
  • Hands-on development and implementation of multiple RAG solutions.
  • Hands-on experience leveraging embedding models and vector databases.
  • Hands-on experience building agentic workflows.
  • Deep familiarity with the LLM ecosystem and the ability to critically assess model capabilities, limitations, and fit for specific tasks, including cost, quality, speed, and capability tradeoffs.
  • Proven experience designing and operating evaluation frameworks to measure LLM output quality, including accuracy, relevancy, and hallucination detection in high-stakes domains (legal, medical, or similar).
  • Strong software engineering foundation with proven experience writing production-deployed solutions, including LLM orchestration frameworks and multi-model pipelines.
  • Comfort working in a fast-paced, high-ambiguity environment with strong ownership, tight feedback loops, and a bias for systematic process-building over one-off fixes.
  • Excellent communication skills; ability to translate complex model evaluation findings into clear recommendations for engineering, product, and non-technical stakeholders.

Related Job Pages

More AI Engineer Jobs

ServiceNow logo

Senior AI Agent Engineer - Moveworks | Customer Deployment

ServiceNow

As the AI platform for business transformation, we're putting AI to work across organizations — freeing people for work that matters. Making old tech work with new tech. Reaching across departments, from the front office to the back office and every office in between. Our ambition? To become the AI defining enterprise software company of the 21st century (or "AI DESCO21C," as we like to call it). With more than 8,400+ customers, we serve approximately 90% of the Fortune 500®, and we're proud to be a Fortune 100 Best Companies to Work For® and World's Most Admired Companies™. Explore your future career with us, visit www.careers.servicenow.com From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

AI Engineer4 days ago
Full TimeRemoteTeam 10,001+Since 2004H1B Sponsor

Company Description It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone-freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow- helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started. Join us to put AI to work for people. Job Description As a Senior AI Agent Engineer - Moveworks | Customer Deployment at Moveworks ServiceNow, you'll be responsible for making customers successful with the Moveworks ServiceNow Platform by accelerating product adoption through various customer engagements. You are a critical, high-leverage technical individual that operates at the intersection of Customer Success, Product Management, and Engineering. Your primary mission is to translate complex customer business process challenges into innovative, high-impact AI solutions built on our platform. This role provides full-stack ownership of technical success, allowing you to not only deploy capabilities in the current product but also directly influence the product's evolution by ensuring that learnings are folded back into our core platform. Core Responsibilities & Impact: - Full-stack Ownership: Partner deeply with customers throughout the entire delivery lifecycle of AI Agents on the Moveworks ServiceNow Platform: Vision-Lock, Solution Design/Architecture, Building, Tuning, and launch. - Custom Solution Design: Architect, design and consult with customers to develop high-impact technical AI solutions on the Moveworks ServiceNow platform by helping them leverage AI in novel and meaningful ways to solve complex business challenges. - Integration and implementation: Integrate the Moveworks ServiceNow Platform to Customer enterprise system in an innovative, secure and performant manner. - Product Partnership: Work closely with engineering and product teams on new product rollouts, and help drive product decision making by synthesizing on-the-ground customer feedback and technical gaps. - Strategic Autonomy: Consult customers and apply creative freedom in solution design to shape the customer's Agentic AI roadmap. About You: You are a technical generalist & a "do-er" with a deep, intuitive understanding of complex systems and a relentless focus on customer impact. You thrive in a dynamic, high-growth environment where you can both build and lead. - Technical Acumen & Curiosity Mindset: You are a rapid learner with high technical aptitude and strong generalist with instincts to quickly learn both new technical and business domains. You possess a curiosity to understand details from both a technical and a business perspective i.e: trying to understand: "what happens under the hood?" and "why is this done that way?" - Technical Mastery: Strong grasp of API based systems integration, LLM-based systems design including prompt engineering, context engineering, and data modeling. - Product Excellence Obsession: You have product taste/judgement and are obsessed with building and delivering exceptional product experiences for users. - Reusability: You share what works with the broader team, and help generalize solutions into reusable templates. - Customer-Centric Soft Skills: You have the communication skills required for deep customer partnerships, and you genuinely enjoy working directly with customers. You are compelled to develop and deliver compelling solution narratives through creation of high-quality artifacts (e.g. architecture diagrams, solution proposals, product documentation, SOWs) as well as engaging presentations and demos, tailored to the technical and business awareness of the audience. - Strategic Guidance & Influence: Serve as a trusted advisor to customers, providing strategic direction to help them overcome technical and organizational obstacles. This includes developing and delivering context-specific solutions, as well as upskilling customer teams to leverage the product independently. - Entrepreneurial Drive / Grit: You aspire to a high-growth career path, actively seeking to gain maximum exposure and learning across engineering, product, and business functions as quickly as possible. You lean into navigating through challenging business situations or antiquated legacy systems. - Ecosystem Partnership: You possess a strong sense of personal accountability to both customers and internal teammates who rely on your expertise. Qualifications To be successful in this role you have: - 5+ years of experience in a technical role, such as a Forward Deployed Engineer, Solutions Engineer, Customer Success Engineer, Solutions Architect, Consulting Engineer or Software Engineer. - Ability to operate across multiple business functions or technical domains, demonstrating adaptability, quick-to-learn, and broad technical skills. - Experience designing, building and launching full-stack workflows, and automations, leveraging REST APIs, iPaaS automation (Workato, Azure Functions, AWS Lambdas, ServiceNow Flow Designer), or generic scripting (e.g., Python, JavaScript, Golang, etc.). - Fully independent practitioner who owns work with minimal guidance, applying in-depth knowledge to problems of diverse scope and evaluating multiple factors to arrive at sound technical decisions. - Track record of contributing ideas and documentation across project teams, not just within immediate assignments. - You are willing to travel up to 25% of the time Preferred Qualifications: - Familiarity with enterprise platforms (e.g. ServiceNow, Jira Service Desk, Zendesk, Workday, Okta, etc.) is a plus - You have familiarity with Linux and Windows environments and using the command line. - You have a great track record of driving successful technical adoption with medium to large-sized enterprise projects - You stay current with the latest AI tools and frameworks, and think about how to apply them thoughtfully to work smarter and build reliable, scalable solutions Additional Information Work Personas We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here . To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service. Equal Opportunity Employer ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. Accommodations We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact globaltalentss@servicenow.com for assistance. Export Control Regulations For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license. .

France
Job Closed
SHOP APOTHEKE EUROPE logo

Product Manager, Agentic AI Platform

SHOP APOTHEKE EUROPE

We are now Redcare Pharmacy - follow our new channel under @redcarepharmacy to stay up-to-date.

AI Engineer4 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Shape the product vision and roadmap for our Agentic AI platform, translating strategic AI ambitions into clear priorities, measurable outcomes, and practical platform capabilities. • Create a strong platform experience for internal users by understanding the needs of engineering, data, AI, and business teams and turning them into scalable, secure, and reliable solutions. • Drive the development of core platform capabilities around LLMOps, MLOps, AI gateway administration, observability, governance, and secure AI enablement. • Partner with engineering teams to improve the way we build and operate platform services, including Azure Cloud, Terraform, GitHub, CI/CD, and Infrastructure as Code. • Bring structure to a fast-evolving AI platform landscape by defining requirements, aligning stakeholders, prioritising opportunities, and helping teams move from ideas to real impact.

Germany
Sowelo Consulting sp. z o.o. sp. k. logo

AI Automation Lead

Sowelo Consulting sp. z o.o. sp. k.

IT Recruitment | RPO | Executive Search | Headhunting | On Time, On Target, On Budget

AI Engineer4 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Identify, qualify, and shape high-impact AI and automation opportunities across diverse business functions • Formulate robust automation roadmaps aligned with Global Business Services (GBS), Shared Services, and enterprise-wide transformation agendas • Conduct rigorous process assessments to identify high-value use cases for artificial intelligence and automation • Direct the design, development, and deployment of sophisticated automation solutions, including RPA, AI/ML workflows and ID • Ensure all technical solutions are highly scalable, secure, sustainable, and strictly aligned with overarching business objectives • Drive measurable cost reduction, operational efficiency, and service optimization through targeted automation initiatives • Construct robust business cases, establishing clear governance frameworks to track ROI and realize tangible business benefits • Seamlessly integrate automation strategies into broader, multi-functional enterprise transformation programs • Partner closely with business unit leaders, IT organizations, and executive leadership teams to align technology with business strategy • Translate complex technical capabilities into compelling, value-driven business propositions for non-technical stakeholders • Serve as a subject matter expert and trusted advisor on intelligent automation strategy and enterprise AI adoption • Establish and refine automation frameworks, operating models, governance structures, and industry best practices • Mentor cross-functional teams and build sustainable automation capabilities for both internal teams and client organizations • Maintain a forward-looking understanding of emerging trends, tools, and methodologies in AI, machine learning, and digital transformation

Poland
SandboxAQ logo

ML Research Engineer, AI for Life Sciences

SandboxAQ

Leveraging AQ - the powerful compound effects of AI + Quantum technology

AI Engineer4 days ago
Full TimeRemoteTeam 51-200Since 2021H1B No Sponsor

• Bring novel ideas and the content of scientific papers into high-performing and robust scientific code. • Lead the ideation, benchmarking, and execution of complex datasets and ML models, ensuring seamless integration into our large-scale simulation frameworks. • Drive software through the entire product lifecycle—from foundational research and implementation to launch and long-term support—ensuring technical excellence at every stage.

United States
$134.4K - $252K / year