Related skills
kubernetes ai ci/cd llm opentelemetryπ Description
- Design, build, and maintain GenAI infrastructure: model gateways, vector databases, and LLM tools.
- Implement secure access controls and default-auth across AI platform components.
- Develop observability, monitoring, and logging for GenAI workloads.
- Collaborate with product and engineering teams to integrate GenAI infra with agent frameworks.
- Optimize infrastructure for scalability, high availability, cost efficiency.
π― Requirements
- Extensive experience building AI platform infra, Kubernetes, and container security.
- Observability and monitoring expertise (OpenTelemetry, MLFlow) for real-time performance.
- Experience with AI infra components: vector databases, prompt/versioning stores, AI IDEs.
- Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
- CI/CD pipelines and automation for AI model deployment and platform ops.
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms.
π Benefits
- CAD 169000-188000 (not overtime eligible) + bonus + benefits.
- Salary ranges reflect target for new hires across CAD locations.
- Total rewards package discussed with recruiter.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!