Related skills
node.js python distributed systems typescript data pipelines📋 Description
- Build scalable eval runners and harnesses for local, CI, and scheduled runs.
- Enable engineers to add high-signal evals with templates, fixtures, and tools.
- Develop benchmark and dataset tooling: curation pipelines, versioning, artifact mgmt.
- Improve reliability and observability for eval execution: retries, idempotency, cost/latency visibility.
- Partner with AI product/platform/infrastructure teams to integrate evals into workflows.
🎯 Requirements
- Strong software engineering fundamentals and production systems experience.
- Proficiency with TypeScript/Node and/or Python.
- Experience building reliable distributed systems (queues, retries, idempotency, backfills).
- Data pipelines experience: batch processing, data quality, versioning, reproducibility.
- Designing measurement/evaluation systems; LLM eval exposure is a plus.
- Curiosity about AI tools and willingness to adopt them to improve outcomes.
🎁 Benefits
- Competitive cash compensation, equity, and benefits.
- In-person collaboration on Anchor Days (Mon/Tue/Thu).
- Notion is an equal opportunity employer.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!