Related skills
grpc rust docker python kubernetes๐ Description
- Design, build, and maintain agentic runtime systems.
- Build and optimize core runtime components: planners, dispatchers, memory, context.
- Advance agent coordination: dynamic tool selection, parallel execution, state management.
- Ensure high availability, reliability, and fault tolerance with graceful degradation.
- Collaborate with ML researchers, product, and platform teams to translate requirements into runtime infra.
- Develop real-time distributed systems powering agent task execution.
๐ฏ Requirements
- 3โ6 years in distributed systems or ML infrastructure; LLM/agentic experience preferred.
- Strong understanding of agent architectures: ReAct, plan-and-execute, multi-agent coordination.
- Context management, prompt lifecycle, tool-call protocols, and agent memory.
- Experience integrating external tool ecosystems: web search, code interpreters, databases, APIs.
- Go and Python 3 proficiency; Rust or TypeScript a plus.
- Distributed systems, microservices, event-driven architectures; real-time streaming and async.
- API design with OpenAPI/Swagger; gRPC for inter-service communication.
- Docker and Kubernetes; cloud platforms (GCP preferred; AWS/Azure optional).
๐ Benefits
- Competitive benefits and training program.
- Inclusive, collaborative office environment.
- Great Place to Work certification.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest โ finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!