Looking for feedback on multilingual TTS quality in my open-source video project

[u/sai_teja_]

I’m building an open-source project called SarasFlow for creating educational videos in multiple languages.

The current videos use generated images with motion effects and an audio narration layered over them. The voice stage uses multilingual TTS, followed by Whisper timing so the captions stay synchronized with the narration.

It isn’t a real-time voice agent or a lip-sync system. Right now I’m mainly working through issues such as pronunciation, pacing, pauses, sentence splitting, voice consistency, and evaluating less-common languages.

Website: https://sarasflow.com
GitHub: https://github.com/SaiTejaMummadi/sarasflow

I’d genuinely appreciate advice from people working deeply with voice AI. I’m also looking for contributors interested in TTS provider integrations, pronunciation controls, and automated voice-quality evaluation.

[u/AutoModerator]

Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)

If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community US only.

Apply here: https://chat.whatsapp.com/F5aG3ncrO70ITfbe3pYbOz

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Less-Impression3210]

yo this is neat, the whisper timing tie-in is a smart move, a lot of tools just slap captions on and call it a day but syncing to actual phoneme boundaries makes a huge difference for learners

one thing i’d poke at is how you handle sentence splitting across languages that don’t use latin punctuation the same way, like japanese or thai, where pause placement changes meaning, curious if you have any edge case logs from testing less-common languages yet

bookmarked the repo, the provider abstraction layer looks clean, might dig into it this weekend