Senior Software Engineer, AI Model serving - Santiago, Chile

About Speechify

Speechify is a leading AI-driven text-to-speech platform that helps millions of people read and absorb content more efficiently. We are hiring a Senior Software Engineer to join our AI Model Serving team in Santiago, Chile.

Role overview

As a Senior Software Engineer for AI Model Serving, you will design, build, and maintain scalable inference services that host AI models for speech and reading experiences. You will work closely with ML researchers and platform engineers to deploy models to production with low latency and high reliability, and you will help improve deployment pipelines, monitoring, and incident response for AI inference workloads.

Responsibilities

• Design, implement, and maintain scalable AI model serving services (inference APIs, model loading, versioning)
• Collaborate with ML researchers to deploy models to production with low latency and high reliability
• Build robust monitoring, tracing, alerting, and incident response for inference services
• Improve CI/CD pipelines for ML workloads and infrastructure as code
• Ensure security, data privacy, and compliance in model serving
• Mentor junior engineers and contribute to architectural decisions

Requirements

• Bachelor's or higher in Computer Science or a related field
• 5+ years of professional software engineering experience
• Strong Python, Go, or Java development skills
• Hands-on experience with ML model serving frameworks (TensorFlow Serving, TorchServe, NVIDIA Triton) and ML workflows
• Experience with distributed systems, microservices, REST and gRPC APIs
• Experience with containerization (Docker) and orchestration (Kubernetes)
• Cloud experience (AWS, GCP, or Azure) and experience with infrastructure as code
• Excellent problem solving and communication skills; proficiency in English

Nice to have

• Experience with MLOps, model monitoring, A/B testing, canary deployments
• Familiarity with Rust or C++
• Knowledge of data privacy requirements

Location

Santiago, Chile (On-site)

What we offer

• Competitive salary and equity
• Health benefits and retirement plans
• Flexible work arrangements and generous time off
• Opportunities for professional growth and impact