NewtonX logo
NewtonX

Your end-to-end market research partner, built to answer your toughest B2B questions with confidence.

Software Engineer - LLM Systems

LLM EngineerMachine Learning EngineerOtherRemoteTeam 51-200Since 2017H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

85 days ago

Salary

$180K - $220K / year

Job Description

Software Engineer - LLM Systems

NewtonX

About NewtonX NewtonX is at the forefront of B2B market research, providing AI-powered insights to deliver firsthand data that the world’s leading Investment firms and enterprises use to make multi-million dollar decisions. As we enter the next stage of growth, we’re seeking a Senior Recruiter experienced in hypergrowth B2B startups to manage NewtonX’s end-to-end recruiting strategy and process. We have partnered with leading organizations like McKinsey, Blackstone, Microsoft, Google, KKR and beyond to equip them with B2B insights to solve pressing business challenges. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. NewtonX has raised $47m in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures. About The Role In this role, you'll own the core LLM infrastructure powering two products redefining B2B research: Hub – The central cockpit for B2B research. Build self-serve features that compress weeks into days: question → expert insight → follow-up, powered by RAG and adaptive workflows. Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value. The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you’ll do the most important work of your career. What We're Looking For Required - You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment - Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar - AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years. - Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices - Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards - Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices Nice To Have - RAG systems, embeddings, semantic search - Real-time data processing or streaming architectures - Open-source contributions in AI/ML What Actually Matters We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs- a side project, an open-source contribution, a blog post that shows how you think- put that at the top of your application. Why Join NewtonX? - Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications - Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms - World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft - High velocity: Ship features that directly impact how billion-dollar decisions are made - Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement - Impact: Your work will directly shape how the world's leading organizations make critical business decisions What We Offer - Excellent medical, dental, and vision insurance. - 401k match with immediate vesting. - Generous Paid time off, holidays, and parental leave. - A diverse, collaborative, and positive culture where we invest in and celebrate each other’s success. Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats). NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Related Job Pages

More LLM Engineer Jobs

Trivium logo

AI Agent Engineer

Trivium

Trivium Group is a full-service Amazon growth agency helping brands scale profitably on the world’s largest marketplace. We fully integrate with your team and become your in-house Amazon team without the price tag. We are built on strong systems, sharp people, and good values.

LLM Engineer86 days ago

AI Agent Engineer (Backend / LLM Systems) 🌍 Remote (International Candidates Welcome) 💰 Salary: $30,000 – $60,000 USD 🕒 Full-Time 🚀 Early-Stage Startup About the Role DDS Marketing is looking for an AI Agent Engineer to own the end-to-end development of AI-powered automation modules that power marketing, operations, and patient engagement for healthcare practices. You will work directly with the founder, who oversees architecture and product direction, and collaborate with one additional developer currently focused on voice AI systems. This role is ideal for someone who enjoys building production AI systems quickly, integrating APIs, and shipping autonomous agents that deliver real-world outcomes. What You’ll Build You will design and deploy a series of AI agents on a 4–5 week sprint cadence, including: SEO Agent Automates content production and search growth. Responsibilities include: - Automated blog generation - Keyword strategy and research - SERP monitoring - CMS publishing pipeline integration Patient Journey Agent Coordinates automated patient communication workflows using real-time data. Examples include - Appointment reminders - Follow-up campaigns - Patient reactivation - Review generation - Multi-step messaging orchestration Ad Deployment Agent Automates digital marketing campaign creation and optimization. Capabilities include: - Programmatic campaign creation - Budget optimization - Lead attribution tracking - Integration with CRM and marketing platforms Voice Agent Improvements You will iterate on an existing AI voice scheduling system built using the OpenAI Realtime API. Responsibilities include: - Improving call reliability - Enhancing conversational logic - Scaling inbound/outbound automation - Integrating voice agents with CRM workflows Voice stack includes integrations such as ElevenLabs. What You’ll Do • Design, build, and deploy AI agent modules from architecture through production • Ship new agent capabilities every 4–5 weeks • Integrate with third-party APIs including: - GoHighLevel - NexHealth - OpenDental - Stripe - Meta Ads - Google Ads • Build LLM-based automation using APIs from OpenAI and Anthropic • Create prompt chains, tool-use patterns, and structured output pipelines • Implement evaluation pipelines and observability tools such as Langfuse and Weights & Biases • Manage CI/CD, deployment, and monitoring for all agent services • Collaborate asynchronously through Slack and GitHub • Contribute to architecture decisions including data models, agent state machines, and error handling Deployment infrastructure includes platforms like Railway.

United States
Job Closed
Gartner logo

VP Analyst, AI Infrastructure Compute

Gartner

Gartner, an information technology research and advisory company, delivers technology-based insights to help companies and organizations around the world make efficient, high-quali

LLM Engineer87 days ago

• Create innovative, thought provoking, and highly leveraged “must-have insight” content • Develop new insights and ideas through thought leadership and offer compelling, actionable approaches to client's needs and requests • Develop in-depth analysis to identify the root cause of a client’s barriers or overall needs and reframe thinking to drive strategy forward • Demonstrate thought leadership in establishing insight positions across a team of analysts • Research, analyze and predict market trends and shifts to provide clients and vendors with actionable insights • Provide clients and prospects with actionable advice aligned to their designated content area via virtual or face-to-face interactions • Create and deliver high value presentation materials on and off stage for Gartner events • Support BTI and Sales: Provide sales support serving as voice of the market • Build credibility as an industry expert to represent Gartner insights, methodology and strategy • Identify research process improvements or develop new processes that help the team and BTI provide excellent service delivery

New York
$194K - $234K / year
Job Closed
NVIDIA logo

Senior AI and LLM Engineer

NVIDIA

NVIDIA is widely considered one of the world's most desirable employers in technology. We have some of the world's most forward-thinking and passionate people working for us. If you're creative and autonomous, we want to hear from you!

LLM Engineer90 days ago
OtherRemoteTeam 10,001+Since 1993H1B Sponsor

• Designing and implementing AI/LLM-powered systems to improve automation, design verification, and workflow efficiency • Collaborating with multi-functional engineering teams to find opportunities for AI integration and performance optimization • Developing and fine-tuning large language models tailored to semiconductor design and productivity applications • Evaluating new frameworks, architectures, and tools to improve efficiencies powered by artificial intelligence across the organization • Tracking and measuring AI impact using data-driven metrics to continuously refine solutions

Arizona + 3 moreAll locations: Arizona | California | Florida | Texas
$184K - $356.5K / year
Job Closed
OtherRemoteTeam 1-10H1B No Sponsor

• Design and deploy production-grade Agentic AI systems where LLMs serve as operational components to reason, explain, and make decisions within live workflows • Architect intelligent pipelines combining classical tools (OCR, fuzzy matching, structured query) with LLM-based validation, confidence scoring, fallback logic, and automated logging for auditability and continuous improvement • Translate ambiguous mission requirements into well-scoped AI system designs; apply prompt and context engineering, RAG, semantic search, and fine-tuning as appropriate; leverage AWS services including Bedrock, Textract, Lambda, and Step Functions • Use generative AI tooling to accelerate the full development lifecycle: requirements analysis, code generation, test coverage, documentation, and deployment scaffolding • Document and quality-assure all project work prior to client delivery; attend meetings with agency staff, vendors, and external stakeholders as needed • Lead or contribute to business development, internal tool-building, mentorship, or publication to strengthen Peregrine's AI capabilities and market position

District of Columbia + 1 moreAll locations: District of Columbia | Washington