Senior Software Engineer, AI Model Serving - Odesa, Ukraine

About Speechify

Speechify is a leading AI-powered reading and listening platform that helps millions of users consume content more effectively. We are expanding our AI model serving capabilities to deliver fast, reliable in-app experiences.

Role Overview

As a Senior Software Engineer, AI Model Serving, you will design, implement, and operate scalable model-serving infrastructure to power Speechify's AI features. You will collaborate closely with ML research and data science teams to productionize models and ensure low-latency inference at scale.

Responsibilities

• Build and maintain production-grade model-serving services and APIs for ML models used in Speechify features.
• Optimize latency, throughput, and reliability of inference pipelines.
• Collaborate with ML researchers to operationalize new models; monitor model performance and drift.
• Design and implement CI/CD pipelines for ML workloads; containerize services with Docker and orchestrate them with Kubernetes.
• Ensure observability (metrics, tracing, logging), security, and robust monitoring.
• Mentor junior engineers and contribute to code reviews.

Requirements

• 5+ years of software engineering experience with strong Python skills.
• Experience with PyTorch or TensorFlow and practical knowledge of ML model serving (TorchServe, Seldon, Ray Serve, or similar).
• Proficiency with containerization and orchestration (Docker, Kubernetes).
• Experience building high-performance APIs (REST, gRPC) and modern Python frameworks (FastAPI, Flask).
• Experience deploying and operating applications on cloud platforms (AWS/GCP/Azure) and implementing ML-focused CI/CD.
• Strong problem solving, debugging, and collaboration skills.

Nice to Have

• Experience with ML experimentation/monitoring tooling (MLflow, Kubeflow).
• Familiarity with data pipelines and telemetry, and knowledge of CUDA or accelerator technologies is a plus.
• Advanced degree in Computer Science or related field is a plus.

Benefits

Competitive compensation and benefits package. Equity opportunities, health coverage, and a culture that values growth and collaboration.

Location

Odesa, Ukraine