Related skills
nlp chatbot python apis data pipelines📋 Description
- Build and run evaluations for LLM-powered chatbot systems.
- Calibrate LLM-as-judge scorers with SMEs.
- Contribute to conversation simulation and replay infra.
- Aid real-time observability tooling for detection of degradation.
- Analyze production conversations for chatbot insights.
- Collaborate with ML engineers on prompts, models, and eval pipelines.
🎯 Requirements
- Pursuing BS, MS, or PhD in CS, Math, Physics, or any engineering field.
- Genuine curiosity about LLMs, AI evaluation, and GenAI systems.
- Familiar with Python; comfortable with APIs, data pipelines, or scripting.
- Basic NLP understanding or hands-on with LLMs is a plus.
- Strong probability theory and stochastic systems knowledge is a plus.
- Strong analytical thinking; questions results before shipping.
- Clear written and verbal communication for technical and non-technical audiences.
- Self-directed and thorough; take ownership and follow through.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!