e-Albania Speech-to-Text
2023Deployed OpenAI Whisper on AWS for Albania's government services portal, enabling speech-to-text for Albanian language.
Deployed for Albania's national services portal
Auto-scaling from zero to handle traffic spikes
Supports Albanian language speech recognition
The Challenge
Deploying a machine learning model for a language with limited training data onto cloud infrastructure with auto-scaling, while maintaining environment parity between local development and production.
Approach
Set up GPU-backed Whisper inference on AWS SageMaker with auto-scaling endpoints. Built REST APIs consumed by the government portal frontend. Solved environment parity challenges between local development and cloud deployment.
Key Highlights
- GPU-backed Whisper inference on AWS SageMaker
- Auto-scaling endpoints for variable load
- REST APIs for speech-to-text and text-to-speech
- Environment parity solution for local dev to cloud deployment
Technologies
PythonOpenAI WhisperAWS SageMaker