Software Engineer - Hosted Model Infrastructure

Added
1 day ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

github rust java docker python

๐Ÿ“‹ Description

  • Build high-performance model serving infra with security and hardware constraints
  • Design auth, rate limiting, concurrency control, and audit logs for multi-tenant access
  • Maintain packaging/deployment pipelines for fast, secure on-prem model rollouts
  • Develop observability for production AI systems to enable monitoring and triage
  • Debug complex issues across stack including inference engines, containers, and GPUs
  • Design and run testing/benchmarking infra to validate deployments on varied GPU hardware

๐ŸŽฏ Requirements

  • 4+ years of professional software engineering experience building/operating production systems
  • CS/Math/Software Eng/Physics or related degree background
  • Proficient in Java, C++, Python, or Rust; Python ML ecosystem familiarity valued
  • Experience with containers, Kubernetes, and deploying backend services in production
  • Strong written and verbal communication; able to iterate quickly with teammates

๐ŸŽ Benefits

  • Medical, dental, and vision insurance; disability coverage
  • Relocation assistance
  • Paid time off and holidays
  • 401(k) plan
  • Life insurance and commuter benefits

๐Ÿšš Relocation support

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’