Senior Engineer: Inference Data Plane

Added
10 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

grpc python kubernetes go vpc

πŸ“‹ Description

  • Architectural leadership: design distributed services and control plane orchestration for AI workloads.
  • System design: proposals for high-scale multi-tenant inference cloud with availability and resiliency.
  • Operational excellence: lead ops strategy, define SLOs, and use observability to maintain health.
  • Cross-functional collaboration: partner with PMs, TPMs, and Eng Mgmt to align roadmaps with business goals.
  • Strategic growth: architecture initiatives for fleet optimization and AI-native networking.

🎯 Requirements

  • Distributed systems mastery: distributed/cloud services, messaging, databases, IaC, observability, security.
  • Cloud infra: networking (VPCs, LB), Kubernetes, storage (block/object/NFS); deep networking.
  • AI/ML domain knowledge: Gen AI platforms, LLM hosting, inference workflows.
  • Operational track record: running customer-facing, high-availability services across regions.
  • Open source engagement: building with open-source software and ownership.
  • Software engineering: Go or Python; gRPC for service-to-service.

🎁 Benefits

  • We innovate with purpose and own impact.
  • Career development resources and growth opportunities.
  • Well-being programs, EAP, and flexible time off.
  • Equity options and potential bonus programs.
  • Remote-friendly benefits and global coverage.
  • Equal-opportunity employer with inclusive culture.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’