Senior Software Engineer, AI Model serving - Colombo, Sri Lanka

Speechify is seeking a Senior Software Engineer to join our AI Model Serving team in Colombo, Sri Lanka. This role focuses on building scalable, low-latency model serving infrastructure for real-time AI applications.

The Role

• Design, implement, and optimize scalable AI model serving infrastructure.
• Collaborate with ML researchers to deploy models to production with low latency and high reliability.
• Build robust APIs for model inference (REST/gRPC) and monitoring.
• Containerize services with Docker and orchestrate with Kubernetes.
• Improve observability, performance, and scalability of the serving stack.

Qualifications

• 5+ years of software engineering experience.
• Strong Python proficiency and experience with PyTorch or TensorFlow.
• Experience deploying ML models to production and building scalable systems.
• Familiarity with cloud platforms (AWS/GCP/Azure) and CI/CD pipelines.
• Strong problem-solving skills and ability to collaborate with cross-functional teams.

Nice to have

• Experience in NLP or speech tech.
• Proficiency in C++ or Go.

About Speechify

Speechify is an AI-powered company focused on transforming the way people consume written content. We build tools that convert text into natural, high-quality speech and make information accessible to everyone.

How to apply

Apply via the Greenhouse posting: Senior Software Engineer, AI Model Serving