Job Closed
This listing is no longer active.
A new kind of education network. Our programs enhance student-faculty engagement, lower costs & leverage opportunities.
Prompt Systems Engineer
Location
United States
Posted
49 days ago
Salary
$115K - $130K / year
Seniority
Mid Level
Job Description
Prompt Systems Engineer
Noodle
• Write, iterate, and maintain system prompts and instruction sets for Noodle’s AI agents across the student journey • Translate complex educational and operational requirements into clear, reliable agent behavior — including persona definition, tone, scope constraints, fallback handling, and multi-turn conversation logic • Design prompt architectures for multi-step and chained agent workflows, including RAG-augmented agents that draw from program-specific knowledge bases • Collaborate with the engineering team to configure and deploy agents through Noodle’s AI orchestration platform, including primary prompts, secondary context, knowledge base attachments, and embed definitions • Create the learner experiences defined by “three-way” chat between the learner, a campus or Noodle support staff member, and that staff member’s AI assistant • Build and maintain evaluation frameworks to measure agent accuracy, tone, hallucination rate, task completion, and alignment with rubric-based learning objectives • Use Langfuse (Noodle’s LLM observability platform) to monitor prompt performance in production, identify regressions, and prioritize prompt improvements • Design red-teaming and adversarial testing protocols to surface edge cases and failure modes before agents reach students • Establish prompt versioning practices and maintain a library of tested, reusable prompt components • Partner with Noodle teammates and university stakeholders to design, build, and test agents — translating learning objectives, operational flows, rubric assessments, and more into prompt-level agent instructions • Work with enrollment and student success teams to tune companion agents for specific programs and university partner contexts • Contribute prompt engineering guidelines and best practices documentation for internal teams who configure their own agents on Noodle’s AI orchestration platform • Stay current with model capability changes across OpenAI, Anthropic, and other providers integrated into Noodle’s stack, and proactively surface opportunities or risks • Perform other duties as assigned
Job Requirements
- 2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment
- Deep familiarity with prompt patterns: few-shot examples, chain-of-thought, system vs. user roles, output formatting constraints, tool-use prompting, and RAG integration
- Strong written communication — you can write clearly, precisely, and persuasively, because that’s the core of the job
- Experience building and running prompt evaluations: defining metrics, writing test cases, and interpreting results to make improvement decisions
- Comfort working across disciplines — you can hold a conversation with an engineer about context windows and with a faculty member about Bloom’s Taxonomy
- Experience with LLM observability tools (Langfuse, Weights & Biases, or similar)
- Familiarity with LTI (Learning Tools Interoperability) and how AI tools plug into LMS platforms like Moodle, Canvas, or Instructure
- Experience with voice agents or multimodal prompting
- Comfort reading and writing basic code (JavaScript, Python) to support prompt automation and testing pipelines
- Knowledge of OpenAI, Anthropic, or other model provider APIs
- Ability to thrive in ambiguity and iterate quickly based on user feedback
- Ability to work effectively in dynamic, rapidly changing, team-based environment
Benefits
- Work from our beautiful NYC office OR the comfort of your home office!
- Computer and charger on us!
- 401(k) with company match, plus equity opportunities
- Medical, dental, and vision insurance for you and your family (including mental health benefits like Headspace and Talkspace)
- Employer-paid life and disability insurance
- Optional voluntary coverage, including supplemental life, accident, critical illness, and hospital insurance
- Health Savings Account (HSA), Flexible Spending Accounts (FSA), and commuter benefits
- Pre-tax benefit options that help you save on eligible healthcare, dependent care, and commuting expenses
- Employee Assistance Program (EAP)
- Paid parental leave
- Wellness initiatives and resources
- Free subscription to the Calm app
- Employee discount program
- 4 weeks of paid vacation + 10 paid holidays + paid sick leave
- Monthly mobile connectivity stipend
- Annual education stipend for lifelong learning
- Growth opportunities - we pride ourselves on creating environments where employees can be themselves and grow within and around the company
Related Guides
Related Categories
Related Job Pages
More Systems Engineer Jobs
Systems Analyst ll – Power Platform
CSGCSG delivers innovative customer engagement solutions that help you acquire, monetize, engage and retain customers.
• Maintain the Power Platform user base , including user setup, access changes, role assignments, and business unit configuration — with Dynamics 365 as a key area of focus. • Support and maintain Power Platform operations during CST time zone coverage, ensuring timely response to production issues, business requests, and operational support needs across platform applications including Dynamics 365. • Perform application configuration changes based on approved business needs and prioritization, including cloud flows, Power Automate workflows, JavaScript updates, table and column changes, business rules, and other declarative or low-code platform updates. • Make production pushes using Azure DevOps pipelines from sandbox to production and support deployment validation and post-deployment checks. • Maintain sandbox environments so they stay current with production configuration and are ready to support testing, validation, and release activities. • Support incident resolution and enhancement requests by documenting issues, validating system behavior, coordinating with technical resources, and implementing or assisting with approved fixes. • Report on platform data as needed , including common reporting areas such as users, contracts, leads, and opportunities within Dynamics 365 and other connected applications. • Partner with business users and technical teams to understand current-state processes, assess impacts, and implement practical system changes that align with business objectives. • Create and maintain system documentation , configuration documentation, training materials, and quick reference guides as needed. • Facilitate and support testing activities for changes delivered to the platform, including unit testing, validation, and business acceptance support. • Stay current on Power Platform capabilities — including Power Apps, Power Automate, Power BI, and Dynamics 365 — and recommend improvements that strengthen process efficiency, reporting, supportability, and platform maturity.
• Assist in planning, conducting and directing the analysis of highly complex business problems to be solved with automated solutions. • Work on mission-critical high value projects with large scale customer impact. • Support development staff by addressing functionality questions and resolving issues. • Assist in creating process engineering and/or business flow assessments to ensure appropriate design of solutions. • Assist with research, evaluating, design and implementing automated solutions that meet the business needs in the most efficient and cost-effective way possible. • Determine necessary program changes. • Evaluate user request for new automated solutions to determine feasibility, time required, and compatibility with other GDS programs/functions. • Consult with user to identify current operating procedures and clarify program objectives. • Verify program logic and correct functionally by implementing test/beta situations. • Estimate and prepare timelines for specific project tasks. • Develop and maintain training and implementation manuals regarding automated systems. • Assist with formulating plans outlining steps required to develop programs and submit plans to the end user for final approval. • Prepares flow charts and diagrams to illustrate sequence of steps the program must follow and to describe logical operations involved. • Work with development teams to estimate and prepare timelines for specific projects.
Business Systems Analyst – TR to ERPs Integration – Oracle
SinqiaFazemos o sistema financeiro pulsar!
• Perform analysis, mapping, and specification of integrations between ERPs and fiscal solutions/DF-e messaging systems for electronic fiscal documents • Gather requirements from tax, accounting, IT, and business areas • Map inbound and outbound fiscal processes within the ERP • Translate tax rules into system requirements • Specify integrations between ERP, DF-e messaging services, and fiscal solutions • Develop field mappings (ERP x fiscal solution x XML) • Analyze XMLs, rejections, and responses from SEFAZ/municipal authorities • Support integrated testing, homologation (UAT) and fiscal validation • Identify data, configuration and process gaps • Document flows, rules, layouts, test scenarios, and acceptance criteria • Work closely with vendors and technical teams
• Maintain and develop ERP (Protheus - TOTVS) functionalities • Optimize processes and respond to business area requests • Develop, customize and optimize routines in Protheus using ADVPL and TL++ • Perform integrations with APIs and external services • Analyze and fix bugs, ensuring stability and performance of solutions • Support implementation and improvements of Backoffice modules (Purchasing, Billing, Finance, Accounting and Tax) • Conduct requirements analysis with business areas and propose appropriate technical solutions • Monitor ERP evolution projects, including updates and migrations • Provide second-level support for complex incidents.
