Engineering Manager, Evals

📋 Description

• Set the eval roadmap end-to-end: what we measure and why it matters.
• Lead and grow a team building eval datasets and developer tools.
• Guide CursorBench to reflect real developer workflows and add new evals.
• Define crisp online quality signals and turn regressions into guardrails.
• Integrate evals into decision-making for launches, deploys, training.

🎯 Requirements

• Led teams shipping production systems with strong leadership.
• Align research, product, data, and infra on what good means; create durable metrics.
• Strong opinions on model and agent behaviors; stay up-to-date on trends.
• Strong data acumen; collaborate with data scientists.
• Built and operated evaluation or measurement systems such as AI evals, experiments, ranking.