Senior Software Engineer, AI Model serving - Bangalore, Karnataka, India

About Speechify

Speechify is a leading text-to-speech technology company that helps people listen to content anywhere, anytime. We design scalable, accessible TTS solutions used by millions of users.

Senior Software Engineer, AI Model Serving – Bangalore, India

Speechify is seeking a Senior Software Engineer to design, build, and scale AI-powered model serving infrastructure in Bangalore. You will work with ML researchers and platform teams to deploy real-time speech synthesis models, optimize latency and reliability, and contribute to architecture decisions across the stack.

What you'll do

• Design and implement scalable AI model serving services and APIs for low-latency speech synthesis.
• Optimize model inference latency, throughput, and resource utilization in cloud and on-prem environments.
• Instrument production systems with monitoring, tracing, and alerts; respond to incidents.
• Collaborate with ML scientists to productionize new models and experiments.
• Build and maintain CI/CD pipelines for ML deployments; ensure test coverage.
• Mentor junior engineers; contribute to system architecture and best practices.

What we’re looking for

• 5+ years of software engineering experience with a track record in building scalable services.
• Strong proficiency in Python (and experience with other languages is a plus).
• Experience with ML frameworks (TensorFlow, PyTorch) and model serving tools (TensorFlow Serving, TorchServe).
• Experience with distributed systems, microservices, Kubernetes, and containerized deployments.
• Cloud experience (AWS, GCP, or Azure) and a solid understanding of observability and performance optimization.
• BS/MS in Computer Science or related field; excellent collaboration and communication skills.

Perks & Benefits

• Competitive salary and equity
• Health insurance and wellness benefits
• Flexible work hours and remote-friendly culture
• Professional growth opportunities and a collaborative team

How to apply

Apply via the Greenhouse listing: Speechify – Senior Software Engineer, AI Model Serving.