LLM Platform Engineer

📋 Description

• Own the infrastructure powering LLMs across business surfaces.
• Build scalable LLM eval frameworks to measure and guide performance.
• Deploy RAG systems and MCP servers with PII controls.
• Design human-in-the-loop feedback pipelines for scalable evaluation.
• Bridge research and production to scale ideas.
• Tackle new technical challenges as we scale AI.

🎯 Requirements

• 4+ years in ML systems and algorithms.
• 3+ years building production software for consumer-scale loads.
• 1+ years developing software in Python.
• Experience with PostgreSQL, DynamoDB, Elasticsearch, Redis.
• DataDog and Grafana for monitoring/logging.
• Familiarity with AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink.

🎁 Benefits

• $225,000 - $320,000/year + benefits + stock options.
• Salary bands may include multiple levels; final salary based on factors.
• Flexible time off and company holidays.
• Health insurance options: Medical, Dental, Vision.
• Work-from-home support and home office setup allowance; monthly cell/internet.
• Parental leave: 16 weeks paid + gradual return.