Prompt Systems Engineer

📋 Description

• Write, iterate, and maintain system prompts for Noodle’s AI agents.
• Translate goals into agent behavior: persona, tone, constraints, fallbacks.
• Design prompt architectures for multi-step and RAG-driven workflows with knowledge bases.
• Collaborate with engineers to deploy agents via Noodle’s AI orchestration platform.
• Create learner experiences via three-way chats among learner, staff, and AI assistant.
• Build evaluation frameworks to measure accuracy, tone, and task completion.

🎯 Requirements

• 2+ years designing prompts for production LLM apps.
• Deep familiarity with few-shot, chain-of-thought, roles, output formatting, tool-use prompting, and RAG.
• Experience building prompt evaluations and test cases.
• Experience with LLM observability tools (Langfuse, Weights & Biases, or similar).
• Familiarity with LTI and LMS integrations (Moodle, Canvas, Instructure).
• Comfort reading/writing JavaScript and Python for automation.

🎁 Benefits

• Work from our NYC office or remote from home.
• Health, dental, and vision insurance for you and family.
• 401(k) with company match + equity opportunities.
• Employer-paid life and disability insurance.
• HSA/FSA and commuter benefits.
• 4 weeks vacation + 10 holidays + paid sick leave.