Senior Software Engineer, AI Model serving - Lodz, Poland

Job Description

Senior Software Engineer, AI Model Serving at Speechify in Lodz, Poland. You will design and implement scalable AI model serving infrastructure, optimize inference performance, and build robust APIs to bring AI models into production. You will collaborate with ML researchers and product teams to deliver reliable, fast, and scalable solutions.

Responsibilities

• Design and implement scalable AI model serving infrastructure and APIs
• Optimize inference latency and throughput for production models
• Collaborate with ML researchers to productionize models and features
• Own deployment pipelines, monitoring, logging, and incident response
• Contribute to code reviews, testing strategies, and CI/CD processes
• Mentor junior engineers and contribute to a collaborative engineering culture

Qualifications

• 5+ years of software engineering experience
• Strong proficiency in Python; experience with Rust or Go is a plus
• Experience with ML model serving frameworks (e.g., TorchServe, TensorFlow Serving, Triton) and containerized environments Docker and Kubernetes
• Cloud experience (AWS, GCP, Azure) and modern CI/CD tooling
• Strong problem solving skills and ability to own features from concept to production
• Bachelor’s degree in Computer Science or related field

About Speechify

Speechify is a leading provider of AI powered text to speech and model-serving solutions, helping teams deliver fast and reliable AI capabilities to end users.

Location

Lodz, Poland