Machine Learning Enginer, Core Evaluations

📋 Description

• Design evaluation pipelines for dev and prod models.
• Design user studies for subjective model evaluations.
• Convert requirements into measurable metrics.
• Build automated evaluation dashboards to compare model performance.
• Train new models to capture new evaluation metrics.
• Lead the evaluation team in the future.

🎯 Requirements

• Design metrics that capture model performance.
• Experience designing user studies on Mechanical Turk or similar.
• Experience training and fine-tuning models for evaluation.
• Strong statistical knowledge to compare results and decide.
• Very strong engineering and programming skills.
• Experience training ASR and TTS models.