Senior Software Engineer, LLMs

📋 Description

• Design and build user-facing ML features that harness LLMs and generative AI to unlock new product capabilities
• Partner with product, design, and ML research to prototype ML experiences
• Own architecture and implementation strategy for applied ML systems with latency considerations
• Build scalable services and APIs that bring model outputs to users in trustworthy and intuitive ways
• Collaborate across teams to ensure ML deployments meet safety and performance standards
• Establish and evangelize best practices for prompt design and model evaluation across the org

🎯 Requirements

• 4+ years software engineering, 2+ years on ML-driven products
• Proven ability to lead complex initiatives across engineering, product, and research
• Strong Python backend (FastAPI/Flask) with Kubernetes, Docker, Terraform
• Experience integrating LLMs/ML into production APIs and apps
• Excellent communication and a collaborative, product-minded approach
• System design focus on latency tradeoffs and user impact for ML features

🎁 Benefits

• Competitive pay with base, bonus, and quarterly equity
• 401(k) with Upstart matching up to $15,000
• ESPP with discounted stock options
• Medical, dental, and vision coverage
• HSA contributions from Upstart
• Paid time off, parental leave, and life/disability coverage