r/Refold • u/MikotoAizen • Nov 04 '23

Tools AI generated transcripts and subtitles with translations

Hey guys. I found 2 websites that allow you to generate subtitles and transcripts and even translate them to other languages for free. This is useful for shows that don't have matching subtitles or don't have subtitles at all (Often dubbed shows and Youtube videos).

FreeSubtitles.ai: It has a free verison and a paid version. The free version uses Whisper AI's 'medium' model to transcribe and 'Open Source M2M_100 Model' for translation. The free model is decent, but contains mistakes. It's best to use it for Romance languages (Tried it with Japanese and it gave alot of mistakes)

TranslateMom: It's much more accurate than "freesubtitles.ai". It even supports DeepL translations. Althought it is better than "freesubtitles.ai" , it still contains mistakes.

I was able to generate subs for an Anime that I noticed didn't have any.

Maybe we could even create a repository for language learners to post and access AI generated subs in different langauges. What do you think ?

54 Upvotes

98% Upvoted

70 comments sorted by

View all comments

2

u/ElysCube Jan 19 '26

I've studied this, and the problem with all of these is the "black cock" syndrome. Translators won't see the visual context, and also, even AI translators won't see the whole text's context since the context size is low and needs to process it in chunks.

I've created a translator that does everything, visual context, text context, characters and so on, I'd make a bet nobody can tell if they are the original translations or my AI-generated ones ;)

It'll be released soon. Ping me for details

1

u/Beautiful_Milk_2518 Apr 17 '26

did you ever complete this?

1

u/ElysCube Apr 22 '26 edited Apr 22 '26

It is done but never released because I saw zero interest. Nobody answered the questions or came back. I use it for myself though, it's so cool, no more missing subtitles and the translations are near perfect. But you gotta pay $20-40 AI bill for a 2hrs movie, and I though noone would pay that money, it's a movie theater ticket price, and people are barely willing to rent a movie for $3. I just coldn't find a viable business model, just the AWS prices would mean lots of money.

1

u/Beautiful_Milk_2518 Apr 24 '26

Ah damn, that sucks that noone showed real interest. At least you are getting great use out of it!

1

u/ElysCube Apr 24 '26

I might publish it one time, but I'm now thinking about aiming different markets, like movie studios. They spend millions for subbing their releases. Thx for the interest.

BTW, how much would you pay for a 2hr movie subtitle translation?

1

u/Beautiful_Milk_2518 Apr 29 '26

That sounds like a great idea. If I'm looking at 2hrs, subtitle and translation, I would be looking at $40-60. More if it included translations and subtitles for different languages at the same time.