Infrastructure Engineer — Sandbox Platform

📋 Description

• Design and Implement the Sandbox Platform: Be the primary engineer responsible for building the core sandbox infrastructure. This includes API design, backend logic, and the underlying orchestration.
• Enforce Hard Isolation: Design and implement mechanisms to run user-provided code and data workloads with strong security and performance isolation on tech (platforms?) like Kata Containers on Kubernetes (k8s) (though we’re open to better systems if you have a preference)
• Enable Core Products: The sandboxes will power: Our new DuckDB-based data warehouse product, Data science notebooks, PostHog AI sandboxes
• Manage performance and costs: Ensure the sandbox environments are highly performant, auto-scaling, and cost-efficient to run at PostHog scale.

🎯 Requirements

• Infrastructure expertise: 3+ years of experience designing, deploying, and maintaining high-availability, high-performance infrastructure.
• Kubernetes chops: Deep, hands-on experience with production k8s environments. You should be comfortable extending k8s or interacting with its APIs at a low level.
• Backend engineering: Strong experience with our core backend language (Python/Django) or similar languages (Go, Rust) in a high-scale environment. Experience building and documenting robust APIs.
• Security & isolation: Experience with container runtime security, virtual machine isolation, and multi-tenancy challenges. You understand the difference between process and kernel isolation.
• Self-direction: Given this is a greenfield project, you thrive on ambiguity, can quickly prototype solutions, and can independently drive a technical vision from concept to production.
• Nice to have: Experience with secure container runtimes (e.g., Kata Containers, gVisor, Firecracker).