Software Engineer - Hosted Model Infrastructure

Added
31 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

github rust java docker python

๐Ÿ“‹ Description

  • Build high-performance model serving infra integrating security and hardware constraints
  • Design request handling: auth, rate limiting, concurrency, audit logs
  • Packaging and deployment pipelines for fast, secure model rollouts
  • Develop observability for production AI systems for monitoring and triage
  • Debug complex issues across stack: inference engines, containers, GPU drivers
  • Design and run tests/benchmarks across GPUs before production

๐ŸŽฏ Requirements

  • 4+ years of professional software engineering experience building/operating production systems
  • Background in CS/Math/Software Engineering/Physics or similar field
  • Proficiency in Java, C++, Python, Rust; Python ML ecosystem valuable
  • Experience with containers, Kubernetes, deploying backends in production
  • Strong written and verbal communication; high bar for quality

๐ŸŽ Benefits

  • Medical, dental, and vision insurance for you and dependents
  • Basic life, AD&D, and disability insurance
  • Commuter benefits
  • Relocation assistance
  • Paid time off and holidays
  • Parental leave and family-building benefits
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’