Staff + Senior Software Engineer, Inference

Added
2 hours ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

rust azure aws python kubernetes

πŸ“‹ Description

  • Design, build, and maintain distributed systems serving Claude to millions worldwide
  • Develop intelligent routing, load balancing, and traffic management across thousands of accelerators
  • Maximize compute efficiency via autoscaling and orchestration of workloads
  • Build and operate deployment pipelines for releasing new models
  • Provide high-performance inference infrastructure for researchers
  • Integrate new AI accelerator platforms and support inference for new model architectures

🎯 Requirements

  • Significant software engineering experience, particularly with distributed systems
  • Results-oriented, with a bias towards flexibility and impact
  • Willingness to pick up slack, even if it goes outside your job description
  • Enjoy pair programming
  • Desire to learn more about machine learning systems and infrastructure
  • Thrive in environments where technical excellence directly drives both business results and research breakthroughs

🎁 Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Lovely office space to collaborate

πŸ›ƒ Visa sponsorship

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’