Senior Software Engineer - Perf and Benchmarking

📋 Description

• Develop Kubernetes-native benchmarking services for latency, throughput, jitter, and cost-per-request across CoreWeave's compute stack.
• Contribute to end-to-end MLPerf Training/Inference workflows, including workload setup, cluster config, and result validation.
• Lead design discussions and influence architecture within the team.
• Break down tasks into milestones and deliver reliable, high-quality code.
• Mentor junior engineers and share benchmarking best practices across teams.

🎯 Requirements

• 3–5 years of experience building distributed systems, HPC components, or cloud services.
• Strong Python or Go skills (C++ a plus) with networking and performance fundamentals.
• Hands-on Kubernetes in production plus CI/CD and observability tools (Prometheus, Grafana, OpenTelemetry).
• Experience with GPU systems (CUDA, NCCL, NVLink/PCIe) or model-serving stacks (llm-d, vLLM, TensorRT-LLM).
• Effective communicator comfortable cross-functionally.

🎁 Benefits

• Medical, dental, and vision insurance – 100% paid by CoreWeave
• Company-paid Life Insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• 401(k) with a generous employer match