LTS logo
LTS

At LTS, we support mission-driven programs that improve healthcare outcomes for Veterans nationwide. Our teams work on innovative modernization initiatives that help transform legacy healthcare systems into secure, scalable, and mission-focused digital solutions. We foster a collaborative environment centered on integrity, innovation, and professional growth while empowering employees to make meaningful contributions to critical federal healthcare missions. LTS shares salary ranges to promote transparency. Compensation ranges are provided for informational purposes, and final compensation may vary based on experience, skills, location, and role requirements.

RAG and Evaluation Engineer

EngineerEngineerFull TimeRemoteSeniorTeam 1,001-5,000H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

7 days ago

Salary

0

Seniority

Senior

Bachelor Degree4 yrs expExperience acceptedEnglishPythonTypeScript

Job Description

RAG and Evaluation Engineer

LTS

• Own the knowledge surface — ingestion pipelines for source code, structured metadata, technical documentation, patches, and additional corpora the customer provides. • Own retrieval quality — chunking, embeddings, hybrid retrieval, reranking, and freshness. • Own the eval harness — benchmarks for translation accuracy, dependency-map correctness, and overall agent quality. • Run A/B testing and regression detection across prompts, retrieval, and model changes. • Operate the feedback loop from production usage back into evals and retrieval. • Define what “good” means for the platform when no one else has a clear view, so the team can tell whether the agent is actually improving. • Pair with the Agent Engineers on the prompt-and-eval iteration cycle.

Job Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Science, or a related field, plus 4 years of professional software engineering experience; equivalent experience may substitute for the degree requirement.
  • Has shipped a production RAG system with quality the candidate can describe in numbers (rigor matters more than scale).
  • Ability to work in a fast-paced, collaborative environment.
  • Production experience with retrieval pipelines — ingestion, chunking, embedding, hybrid retrieval, reranking.
  • Strong applied evaluation skills — benchmark design, regression detection, LLM-as-judge patterns.
  • Knows when BM25 beats embeddings and when neither is enough.
  • Measures everything they ship; opinions about chunking are backed by benchmarks.
  • Patient with detail; comfortable defining metrics before the team has agreed on them.
  • Heavy native use of AI tooling: agents in parallel, model as collaborator.
  • Strong TypeScript or Python.
  • Demonstrated experience in a remote work environment.

Benefits

  • The opportunity to support high visibility federal missions in IT and healthcare
  • A culture that values innovation, growth, collaboration, and quality
  • Access to cutting-edge tools and technologies
  • Comprehensive benefits for you and your family
  • A career path that rewards ambition and performance

Related Categories

Related Job Pages

More Engineer Jobs

Ulteig logo

Lead Development Engineer – Renewables

Ulteig

Ulteig describes itself as a leader in the engineering industry, working in partnership with organizations that build, maintain, and revitalize infrastructure a

Engineer7 days ago

• Support multiple projects in various development-stage phases from proposal through kickoff, design, delivery, and revision while maintaining schedules with other disciplines and a positive relationship with clients. • Provide expert-level knowledge of solar photovoltaic (PV) electrical design including string sizing, cable sizing, ampacity, 1500V DC, 34.5kV MV, and National Electric Code (NEC) requirements for utility-scale PV power plants. • Work with internal team and external clients to develop packages including solar array layouts, electrical one-lines, collection systems, collection system studies, and equipment installation details for Utility Scale Solar PV systems (50-500MW+). • Apply current, standard engineering techniques, procedures and criteria to complete engineering tasks, and support other civil, structural, and electrical design workflows as necessary on a case by case basis. • Contribute to continual development of internal solar engineering standards, toolsets and work processes. • Develop plans, details, and reports that are complete, accurate and in accordance with sound utility-scale renewables early-stage development engineering practices. • Work closely with and provide guidance to engineering technicians and design engineers. • Partner with clients to understand priorities and technical needs, then develop feasible valued engineered solutions that achieve project goals. • Check design and computations performed by internal design team and provide ideas and execute to promote higher quality designs. • Review development plans and specifications for constructability, safety, and risk considerations. • Work closely with marketing, sales, business development, and engineering staff across multiple markets and technical disciplines. • Demonstrate a wide degree of out-of-the-box thinking, creativity, and design ownership. • Lead site visits to gather notes and take pictures of existing conditions to aid in design and identify critical flaws.

United States
$111.2K - $150.4K / year
Branch logo

Senior Software Engineer, Platform

Branch

We provide cross-platform linking and attribution solutions to the world's leading digital brands.

Engineer7 days ago
Full TimeRemoteTeam 501-1,000Since 2014H1B Sponsor

Role Description In this Senior Software Engineer role at Branch, you will be responsible for developing core components on one of our Engineering pods. The ideal candidate will have strong experience in Java and microservices, with a focus on designing and optimizing scalable backend services and RESTful APIs. This position requires a solid foundation in computer science and a passion for upholding high engineering standards through code reviews and collaborative teamwork. - Measure and optimize the performance, scalability, and uptime of backend services - Demonstrate and promote a culture of engineering excellence - Conduct design and code reviews and push the bar for engineering rigor and standards - Collaborate with product management, customer success, and customer support to deliver the best experience for our users - Focus on consistent, cohesive REST APIs and domain driven service design to facilitate and orchestrate service contracts Qualifications - Attention to detail and passion for doing great work - 5+ years of experience in building clean, well architected, distributed, and scalable software - Strong computer science fundamentals, with deep knowledge of data structures, algorithms, and software design - Strong command of Java and Java based microservices with Spring Boot - Experience designing and supporting customer facing RESTful APIs - Design and implementation of relational database schemas running on PostgreSQL, MySQL, Oracle, or equivalent - Fluent with unit/integration testing concepts and tools including JUnit/Mockito, or equivalent - Experience with Docker, Kubernetes, git-flow, SonarQube for CICD a plus - BS in Computer Science or equivalent program Requirements - The salary range for this role is $160-170k. - The salary range displayed reflects an average base salary range for the position across all the U.S. - The base salary offered to an applicant could be higher or lower based on each applicant's specific skill set, depth of experience, relevant education or training, etc. - This position is classified as REMOTE within the United States of America. - We are unable to hire candidates located outside of the domestic U.S. Benefits - Market-leading medical, dental, and vision insurance - Stock options - Free Premium-Tier Origin Financial Wellness subscription - Monthly home-office stipend - 401k (TransAmerica) - 12-weeks paid parental leave for birthing and non-birthing parents - Flexible time off + sick and safe time - 11 paid company holidays

United States
$160K - $170K / year
Engineer7 days ago
Full TimeRemoteTeam 201-500Since 2008H1B No Sponsor

• We're looking for a teammate who wants to grow with us and contribute long-term to the Cívica team. • The role to be filled is AI Data Engineer with a focus on: ⚙️ Agentic Systems ☁️ Google Cloud Platform 🧠 Language Models and Generative AI 📈 AgentOps and Observability 🐍 Python Backend Development 🤝 Multidisciplinary Collaboration

United States
Fairwinds Technologies logo

Senior DSP Engineer, Remote with Travel

Fairwinds Technologies

Communications, networking and information technology solutions for defense and civilian agencies around the world.

Engineer7 days ago
Full TimeRemoteTeam 51-200Since 2016

• Design, develop, and optimize DSP algorithms for RF communications signals, including waveform processing in contested and dynamic environments (e.g., filtering, synchronization, channelization, detection/estimation, demodulation/decoding, interference mitigation). • Lead algorithm development from concept through prototype to implementation, balancing performance, latency, robustness, and computational constraints. • Implement and validate DSP solutions on heterogeneous compute platforms including Xilinx RFSoC, UltraScale+, and Versal, leveraging PL/PS resources and hardware acceleration as appropriate. • Collaborate with FPGA engineers to translate algorithms into hardware-realizable architectures (fixed-point design, throughput/latency optimization, resource trade studies, hardware-friendly formulations). • Work closely with embedded software engineers to integrate real-time DSP pipelines (drivers, data movement, DMA, streaming interfaces, buffering strategies, runtime configuration). • Develop and execute test/verification strategies using lab instrumentation and captured RF datasets; characterize performance under impairments (CFO/phase noise, multipath, fading, interference/jamming, nonlinearities). • Develop simulation and analysis environments (e.g., MATLAB/Simulink, Python) and correlate simulation results to hardware/field behavior. • Provide technical leadership: define architecture, conduct design reviews, mentor engineers, and communicate trade-offs clearly to stakeholders. • Produce high-quality documentation (DSP design descriptions, algorithm specs, performance reports, ICD inputs, SBIR deliverables as required). • Support integration, debug, and field test activities spanning DSP, RF, FPGA, and embedded software domains.

Florida + 2 moreAll locations: Florida | Maryland | Virginia
$175K - $200K / year