Software Engineer - Hosted Model Infrastructure

Added
4 hours ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

rust java docker python kubernetes

๐Ÿ“‹ Description

  • Build high-performance model serving infra with security and hardware constraints
  • Design request handling: auth, rate limit, concurrency, audit logging
  • Create packaging and deployment pipelines for on-prem and air-gapped deploys
  • Develop observability for production AI to enable monitoring and triage
  • Debug stack issues across engines, containers, GPU drivers in restricted environments
  • Design and run tests/benchmarks to validate deployments on varied GPUs

๐ŸŽฏ Requirements

  • 4+ years building and operating production software systems
  • Background in CS, Math, Software Eng, or Physics
  • Strong coding in Java, C++, Python, or Rust
  • Experience with containers, Kubernetes, and production deployment
  • Strong communication and ability to iterate quickly with teammates
  • Familiarity with Python ML ecosystem is a plus

๐ŸŽ Benefits

  • Medical, dental, and vision insurance; voluntary life insurance
  • Basic life, AD&D and disability insurance
  • Commuter benefits
  • Relocation assistance
  • Take what you need paid time off, not accrual
  • Palantir 401k plan enrollment

๐Ÿšš Relocation support

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’