Malay–English Sermon Translation

Real-time subtitle synchronization for live sermons with human-in-the-loop verification workflow.

Lead Developer

2025 (Final Year Project)

FastAPIFaster-Whisper Large-V3WebSocketsPostgreSQLPython

Source Code

Project Screenshots

Malay–English Sermon Translation screenshot 1

Malay–English Sermon Translation screenshot 2

Malay–English Sermon Translation screenshot 3

Overview

A real-time translation system that provides live Malay-to-English subtitles for mosque sermons. The system uses speech recognition, machine translation, and a human-in-the-loop verification workflow to ensure accuracy for religious content.

Problem & Constraints

Non-Malay speaking congregants at Malaysian mosques miss the content of Malay sermons. Automated translation alone is insufficient for religious content where accuracy is critical. The system needed to provide real-time subtitles while allowing human verification before display.

Solution

I designed and implemented a multi-stage pipeline: • **Speech Recognition** - Faster-Whisper Large-V3 for accurate Malay transcription • **Translation** - Machine translation with domain-specific fine-tuning • **Human Verification** - Admin interface for real-time correction before broadcast • **Multi-client Delivery** - WebSocket-based distribution to multiple display endpoints • **PostgreSQL** - Sermon archives with full-text search

Impact & Results

• **Real-time subtitle delivery** with <2 second latency • **Multi-client support** for simultaneous display on multiple screens • **Human-in-the-loop** ensures religious accuracy • **Archived sermons** with searchable transcripts • Successfully demonstrated in university mosque setting

What I'd Improve Next

• Add support for Arabic source sermons • Implement speaker diarization for multi-speaker events • Add mobile app for congregants to view on personal devices • Integrate with mosque booking/management systems • Deploy as SaaS for multiple mosques

Back to all projects Get in touch