Own the roadmap for AI observability across instrumentation and debugging.
Collaborate on AI evaluation roadmap via LLM-based judges.
Build default instrumentation templates to observe LLM workloads.
Partner with engineering for root-cause workflows across LLM chains and prompts.
Define and track success metrics for AI observability.
Based in Toronto with flexible remote options.

🎯 Requirements

2+ years as Product Manager or equivalent.
ML/AI development flow knowledge; comfortable with LLM patterns.
Aware of LLM evaluation methods (golden datasets, human-in-loop).
Comfortable partnering with engineers on tradeoffs and design.
Strong product fundamentals: discovery, prioritization, roadmap, and stakeholder alignment.
Metrics-driven; you can define outcomes and iterate on evidence.

🎁 Benefits

Flexible remote work options.
Equal opportunity employer; accommodations available.

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Product Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot