Related skills
apis observability sdks routing llm📋 Description
- Design and operate scalable AI infra for LLM inference, prompts, and evaluation.
- Build self-service tools, SDKs, and APIs to accelerate production.
- Instrument production AI/ML workloads with standardized logging, tracing, and metrics.
- Implement intelligent routing and caching via the LLM gateway to reduce compute costs.
- Drive adoption of shared platform services across new AI features.
- Champion developer experience with documentation and responsive support.
🎯 Requirements
- Built and deployed production AI infrastructure with enterprise-grade reliability.
- Delivered self-service tools or APIs enabling teams to accelerate AI/ML development.
- Implemented evaluation frameworks, A/B testing, or monitoring to measure model performance, latency, cost, and quality.
- Led cost-reduction efforts via intelligent routing and caching.
- Migrated teams to shared platform services to drive adoption.
- Improved developer experience through documentation and support.
🎁 Benefits
- £5,000 training and conference budget for individual and group development.
- 25 days of holiday plus 8 bank holidays (33 days total).
- Company pension scheme via Penfold.
- Mental health support and therapy via Spectrum.life.
- Individual wellbeing allowance via Juno.
- Private healthcare insurance through AXA.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!