Senior Engineer: Inference Data Plane

Added
20 hours ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

grpc cloud infrastructure python kubernetes distributed systems

πŸ“‹ Description

  • Architect distributed services for AI infrastructure control plane.
  • Lead design for multi-tenant inference cloud systems.
  • Define SLOs, observability, and high-availability for the platform.
  • Collaborate with Product, TPMs, and Eng managers on roadmaps.
  • Hands-on coding to build scalable AI hosting infrastructure.

🎯 Requirements

  • Distributed systems mastery across cloud services.
  • Cloud networking, VPCs, load balancers, Kubernetes, and storage.
  • AI/ML domain knowledge: Gen AI platforms, LLM hosting, inference workflows.
  • Operational track record for high-availability, multi-region services.
  • Open-source engagement and ownership mindset.
  • Go or Python proficiency; gRPC for service communication.

🎁 Benefits

  • Career development resources and LinkedIn Learning access.
  • Well-being programs, flexible time off, and local meetups.
  • Reimbursement for conferences, training, and education.
  • Equity compensation and Employee Stock Purchase Program.
  • DigitalOcean is an equal-opportunity employer.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’