Founded in 2013, Noodle is dedicated to education in all its forms, from graduate degrees to weekend classes, and offers a "well-researched" database through wh
Prompt Systems Engineer
Location
United States
Posted
1 day ago
Salary
$115K - $130K / year
Seniority
Mid Level
Job Description
Prompt Systems Engineer
Noodle
• Write, iterate, and maintain system prompts and instruction sets for Noodle’s AI agents across the student journey • Translate complex educational and operational requirements into clear, reliable agent behavior — including persona definition, tone, scope constraints, fallback handling, and multi-turn conversation logic • Design prompt architectures for multi-step and chained agent workflows, including RAG-augmented agents that draw from program-specific knowledge bases • Collaborate with the engineering team to configure and deploy agents through Noodle’s AI orchestration platform, including primary prompts, secondary context, knowledge base attachments, and embed definitions • Create the learner experiences defined by “three-way” chat between the learner, a campus or Noodle support staff member, and that staff member’s AI assistant • Build and maintain evaluation frameworks to measure agent accuracy, tone, hallucination rate, task completion, and alignment with rubric-based learning objectives • Use Langfuse (Noodle’s LLM observability platform) to monitor prompt performance in production, identify regressions, and prioritize prompt improvements • Design red-teaming and adversarial testing protocols to surface edge cases and failure modes before agents reach students • Establish prompt versioning practices and maintain a library of tested, reusable prompt components • Partner with Noodle teammates and university stakeholders to design, build, and test agents — translating learning objectives, operational flows, rubric assessments, and more into prompt-level agent instructions • Work with enrollment and student success teams to tune companion agents for specific programs and university partner contexts • Contribute prompt engineering guidelines and best practices documentation for internal teams who configure their own agents on Noodle’s AI orchestration platform • Stay current with model capability changes across OpenAI, Anthropic, and other providers integrated into Noodle’s stack, and proactively surface opportunities or risks • Perform other duties as assigned
Job Requirements
- 2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment
- Deep familiarity with prompt patterns: few-shot examples, chain-of-thought, system vs. user roles, output formatting constraints, tool-use prompting, and RAG integration
- Strong written communication — you can write clearly, precisely, and persuasively, because that’s the core of the job
- Experience building and running prompt evaluations: defining metrics, writing test cases, and interpreting results to make improvement decisions
- Comfort working across disciplines — you can hold a conversation with an engineer about context windows and with a faculty member about Bloom’s Taxonomy
- Experience with LLM observability tools (Langfuse, Weights & Biases, or similar)
- Familiarity with LTI (Learning Tools Interoperability) and how AI tools plug into LMS platforms like Moodle, Canvas, or Instructure
- Experience with voice agents or multimodal prompting
- Comfort reading and writing basic code (JavaScript, Python) to support prompt automation and testing pipelines
- Knowledge of OpenAI, Anthropic, or other model provider APIs
- Ability to thrive in ambiguity and iterate quickly based on user feedback
- Ability to work effectively in dynamic, rapidly changing, team-based environment
Benefits
- Work from our beautiful NYC office OR the comfort of your home office!
- Computer and charger on us!
- 401(k) with company match, plus equity opportunities
- Medical, dental, and vision insurance for you and your family (including mental health benefits like Headspace and Talkspace)
- Employer-paid life and disability insurance
- Optional voluntary coverage, including supplemental life, accident, critical illness, and hospital insurance
- Health Savings Account (HSA), Flexible Spending Accounts (FSA), and commuter benefits
- Pre-tax benefit options that help you save on eligible healthcare, dependent care, and commuting expenses
- Employee Assistance Program (EAP)
- Paid parental leave
- Wellness initiatives and resources
- Free subscription to the Calm app
- Employee discount program
- 4 weeks of paid vacation + 10 paid holidays + paid sick leave
- Monthly mobile connectivity stipend
- Annual education stipend for lifelong learning
- Growth opportunities - we pride ourselves on creating environments where employees can be themselves and grow within and around the company
Related Guides
Related Categories
Related Job Pages
More Systems Engineer Jobs
Systems Analyst – II
CSGCSG delivers innovative customer engagement solutions that help you acquire, monetize, engage and retain customers.
• Maintain the Dynamics 365 user base, including user setup, access changes, role assignments, and business unit configuration for all Dynamics 365 users. • Support and maintain Dynamics 365 operations during CST time zone coverage, ensuring timely response to production issues, business requests, and operational support needs. • Perform application configuration changes based on approved business needs and prioritization, including cloud flows, JavaScript updates, table and column changes, business rules, and other declarative or low-code platform updates. • Make production pushes using Azure DevOps pipelines from sandbox to production and support deployment validation and post-deployment checks. • Maintain sandbox environments so they stay current with production configuration and are ready to support testing, validation, and release activities. • Support incident resolution and enhancement requests by documenting issues, validating system behavior, coordinating with technical resources, and implementing or assisting with approved fixes. • Report on Dynamics data as needed, including common reporting areas such as users, contracts, leads, and opportunities. • Partner with business users and technical teams to understand current-state processes, assess impacts, and implement practical system changes that align with business objectives. • Create and maintain system documentation, configuration documentation, training materials, and quick reference guides as needed. • Facilitate and support testing activities for changes delivered to the platform, including unit testing, validation, and business acceptance support. • Stay current on Dynamics 365 platform capabilities and recommend improvements that strengthen process efficiency, reporting, supportability, and platform maturity.
• Assist in planning, conducting and directing the analysis of highly complex business problems to be solved with automated solutions. • Work on mission-critical high value projects with large scale customer impact. • Support development staff by addressing functionality questions and resolving issues. • Assist in creating process engineering and/or business flow assessments to ensure appropriate design of solutions. • Assist with research, evaluating, design and implementing automated solutions that meet the business needs in the most efficient and cost-effective way possible. • Determine necessary program changes. • Evaluate user request for new automated solutions to determine feasibility, time required, and compatibility with other GDS programs/functions. • Consult with user to identify current operating procedures and clarify program objectives. • Verify program logic and correct functionally by implementing test/beta situations. • Estimate and prepare timelines for specific project tasks. • Develop and maintain training and implementation manuals regarding automated systems. • Assist with formulating plans outlining steps required to develop programs and submit plans to the end user for final approval. • Prepares flow charts and diagrams to illustrate sequence of steps the program must follow and to describe logical operations involved. • Work with development teams to estimate and prepare timelines for specific projects.
Business Systems Analyst – TR to ERPs Integration – Oracle
SinqiaFazemos o sistema financeiro pulsar!
• Perform analysis, mapping, and specification of integrations between ERPs and fiscal solutions/DF-e messaging systems for electronic fiscal documents • Gather requirements from tax, accounting, IT, and business areas • Map inbound and outbound fiscal processes within the ERP • Translate tax rules into system requirements • Specify integrations between ERP, DF-e messaging services, and fiscal solutions • Develop field mappings (ERP x fiscal solution x XML) • Analyze XMLs, rejections, and responses from SEFAZ/municipal authorities • Support integrated testing, homologation (UAT) and fiscal validation • Identify data, configuration and process gaps • Document flows, rules, layouts, test scenarios, and acceptance criteria • Work closely with vendors and technical teams
• Maintain and develop ERP (Protheus - TOTVS) functionalities • Optimize processes and respond to business area requests • Develop, customize and optimize routines in Protheus using ADVPL and TL++ • Perform integrations with APIs and external services • Analyze and fix bugs, ensuring stability and performance of solutions • Support implementation and improvements of Backoffice modules (Purchasing, Billing, Finance, Accounting and Tax) • Conduct requirements analysis with business areas and propose appropriate technical solutions • Monitor ERP evolution projects, including updates and migrations • Provide second-level support for complex incidents.
