Staff + Sr. Software Engineer, Cloud Inference

Added
5 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

rust azure aws python kubernetes

πŸ“‹ Description

  • Design, build, and own backend services for Claude across CSPs.
  • Collaborate with internal teams and CSPs to stand up the full serving stack on new clouds.
  • Build and evolve CI/CD automation pipelines to ship model versions at scale with no regressions.
  • Design CSP interfaces and tooling for cost-effective, cross-provider inference.
  • Contribute to capacity planning, autoscaling, and workload routing strategies.
  • Analyze observability data across providers to identify bottlenecks and regressions.

🎯 Requirements

  • Extensive software engineering experience in large-scale distributed systems.
  • Experience on AWS, GCP, or Azure; exposure to Kubernetes or IaC.
  • Curious about LLM serving; ML/inference experience not required.
  • Thrives in cross-functional collaboration with internal teams and partners.
  • Experience working with external partners to align goals and deliver impact.
  • Fast learner who can ramp up on new technologies, hardware, and provider ecosystems.
  • Highly autonomous and end-to-end ownership, including work beyond role.

🎁 Benefits

  • Competitive compensation and benefits.
  • Optional equity donation matching.
  • Generous vacation and parental leave.
  • Flexible working hours.
  • Attractive SF office space for collaboration.

πŸ›ƒ Visa sponsorship

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’