Related skills
nlp python data annotation psychometrics datasets📋 Description
- Design research studies to define 'good performance' across contexts.
- Build datasets, annotation frameworks, and ground-truth labels.
- Own the bias audit process: identify bias and propose changes.
- Interview customers and industry to translate signals into measures.
- Write and maintain documentation on research methods for teams.
- Stay current on literature in educational measurement, psychometrics, and LLM eval.
🎯 Requirements
- Master's or PhD in cognitive science, NLP, educational measurement, or related field.
- Design methodology from scratch; define data needs and questions.
- Digitally self-sufficient; write scripts, scrape data, and run analyses.
- Think carefully about fairness in measurement as a design constraint.
- Communicate findings to non-researchers; clarify methods for PMs.
- Experience running user research or qualitative studies with quantitative modeling.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!