Design, build, and maintain GenAI infra (model gateways, vectors, versioning tools)
Implement secure access controls and authentication integrated by default
Develop observability, monitoring, and logging for GenAI workloads
Collaborate with product/engineering to integrate GenAI infra with agent frameworks
Optimize infra for scalability, HA, and cost efficiency

🎯 Requirements

Experience building AI platform infra with Kubernetes and container security
Observability expertise (OpenTelemetry, MLFlow)
AI infra components: vector databases, prompt/versioning stores, AI IDEs
Familiarity with vLLM, SGLang or similar for hosting LLM inference workloads
CI/CD pipelines and automation for AI model deployment
Strong knowledge of authentication/authorization in AI platforms

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot