Related skills
http rust kubernetes distributed systems websocket📋 Description
- Build core components of the serverless inference platform.
- Optimize model scheduling for efficiency and resource use.
- Improve inference request routing to reduce latency.
- Improve platform reliability by mitigating systemic risks.
- Expand observability with metrics, logging, tracing, alerts.
- Lead cross-functional projects from concept to deployment.
🎯 Requirements
- Systems engineering in distributed, high-performance systems.
- Expert Rust programming, asynchronous.
- Networking: TCP, HTTP, WebSocket.
- Scaling and performance optimization: load balancing and caching.
- Kubernetes and/or Nomad orchestration.
- LLM/diffusion model inference serving.
🎁 Benefits
- Work on an AI inference platform at the edge.
- Inclusive AA/Veterans/Disabled employer.
- Reasonable accommodations for applicants with disabilities.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!