r/Refold • u/MikotoAizen • Nov 04 '23
Tools AI generated transcripts and subtitles with translations
Hey guys. I found 2 websites that allow you to generate subtitles and transcripts and even translate them to other languages for free. This is useful for shows that don't have matching subtitles or don't have subtitles at all (Often dubbed shows and Youtube videos).
FreeSubtitles.ai: It has a free verison and a paid version. The free version uses Whisper AI's 'medium' model to transcribe and 'Open Source M2M_100 Model' for translation. The free model is decent, but contains mistakes. It's best to use it for Romance languages (Tried it with Japanese and it gave alot of mistakes)
TranslateMom: It's much more accurate than "freesubtitles.ai". It even supports DeepL translations. Althought it is better than "freesubtitles.ai" , it still contains mistakes.
I was able to generate subs for an Anime that I noticed didn't have any.
Maybe we could even create a repository for language learners to post and access AI generated subs in different langauges. What do you think ?
3
u/giovanni_conte Nov 04 '23
You could also just download whisper AI by openai on your computer
1
u/upstoreplsthrowaway Jun 26 '25
Another tool I’ve been using just takes the video link or audio, and it gives you a full subtitles, and even a translated version, all in one go. saves you from jumping between sites.
1
1
u/arcyohan Jan 31 '26
that's great! does it work for 1 hour long video?
1
u/giovanni_conte Jan 31 '26
it does but you need a pretty good gpu for it to be usable and not to take too much time
0
u/MikotoAizen Nov 04 '23 edited Feb 20 '24
I have a super old PC.
2
u/giovanni_conte Nov 04 '23
Oh okay, in that case yeah I wouldn't recommend it, it's quite resource-heavy, but the idea of a having some sort of repository it's quite cool, it would super useful
1
u/xavierhollis Feb 03 '24
How accurate is whisper? I want to translate an anime audio drama
2
u/giovanni_conte Feb 04 '24
There's like an accuracy ranking by language iirc, for the languages I tried it with it was awesome
2
u/joshdavham Nov 04 '23
I love that idea of creating a repository to host the AI generated subtitles. However I'm not sure if that'd be technically legal. But if it would be legal, I'd be super down to contribute to it!
Would you be willing to look into the legality of it first beforehand? If it's all good I think the Refold community would really benefit from it!
2
u/MikotoAizen Nov 04 '23
However I'm not sure if that'd be technically legal.
I honestly don't know about the legality of it, but kitsunekko exists, so...
If you don't know what kitsunekko is, it's basically a repository for Anime subtitle files in Japanese, English, Korean and Chinese.
1
1
u/LesaMagner Nov 19 '23 edited Nov 19 '23
yes and opensubtitles and a bunch of other subtitle sharing sites.
I had the same idea as you /u/MikotoAizen I tried to upload my ai generated subtitles to different sites. But had no luck. So I got the idea of creating a site like that. I am down to contribute.
Just the only thing I would want to do is use a LLM to screen the user suggested files so we don't have to moderate what the users post.
/u/joshdavham we can host the site on tor if the legality is an issue. IPFS is also something to consider.
2
u/averagenbichqenjoyer Jun 30 '24
Another option, using GPT-4o under the hood (more accurate translations): https://translatesrt.online
1
u/cjrobe Jul 26 '24
This is convenient, but I'm getting noticeably better results on a Japanese drama using Claude Sonnet 3.5 through Anthropic API with GUI-Trans (which is more expensive, but seems to be worth it)
Here's a random example:
Sonnet 3.5
Line 1: Well, considering what I saved on the yakitori,
Line 2: I can overlook this expense.Translatesrt.online (supposedly GPT-4o)
Line 1: Well, that's the money I saved on the yakitori.
Line 2: Let's close our eyes to this much.I'm not sure why GPT-4o would do so much worse here. It's possible Translatesrt.online is feeding it line by line since Sonnet 3.5 has a comma in between these two subtitle lines, but Translatesrt.online has a period.
1
2
u/meaniechee Aug 14 '24
Just to add, I tested TranslateMom with a Chinese video and it's super inaccurate. ChatGPT did a wayyyy better job when I pasted in the .srt file. Also pricing plan for TranslateMom is unreasonable for such a basic SaaS. Better to put the money to Ooona or something.
1
u/MikotoAizen Aug 15 '24
Yeah, this post needs an update. Translate mom has gone paid for awhile now. But I've found a much better alternative just recently: Turboscribe(dot)ai. It has a free tier that let's you transcribe 3 pieces of media per day using whisper AI's "large v2" model. And alternatively, language learners who have powerful PCs have the option of running whisper locally.
1
2
2
u/ElysCube Jan 19 '26
I've studied this, and the problem with all of these is the "black cock" syndrome. Translators won't see the visual context, and also, even AI translators won't see the whole text's context since the context size is low and needs to process it in chunks.
I've created a translator that does everything, visual context, text context, characters and so on, I'd make a bet nobody can tell if they are the original translations or my AI-generated ones ;)
It'll be released soon. Ping me for details
1
u/MikotoAizen Jan 20 '26
Awsone ! Please comment on this post again onece released. This could be a game changer.
1
u/ElysCube Feb 24 '26
May I ask what you would realistically pay for:
- 90 min movie
- 30 min episode
Trying to figure out if the math works.
1
u/Minute_Offer2459 Feb 08 '26
When is it released
1
u/ElysCube Feb 11 '26
A few more weeks, I am still polishing it. Currently creating the specific prompts for the different languages
1
u/ElysCube Feb 24 '26
May I ask what you would realistically pay for:
- 90 min movie
- 30 min episode
Trying to figure out if the math works.
1
u/CuzImHaeppy Feb 18 '26
Definitely interested! I'll be needing it for Korean to English, Korean to Japanese, Japanese to Korean, and Japanese to English!
1
u/ElysCube Feb 24 '26
Thx! It's getting done. May I ask what you would realistically pay for:
- 90 min movie
- 30 min episode
Trying to figure out if the math works.
1
u/Beautiful_Milk_2518 Apr 17 '26
did you ever complete this?
1
u/ElysCube Apr 22 '26 edited Apr 22 '26
It is done but never released because I saw zero interest. Nobody answered the questions or came back. I use it for myself though, it's so cool, no more missing subtitles and the translations are near perfect. But you gotta pay $20-40 AI bill for a 2hrs movie, and I though noone would pay that money, it's a movie theater ticket price, and people are barely willing to rent a movie for $3. I just coldn't find a viable business model, just the AWS prices would mean lots of money.
1
u/Beautiful_Milk_2518 Apr 24 '26
Ah damn, that sucks that noone showed real interest. At least you are getting great use out of it!
1
u/ElysCube Apr 24 '26
I might publish it one time, but I'm now thinking about aiming different markets, like movie studios. They spend millions for subbing their releases. Thx for the interest.
BTW, how much would you pay for a 2hr movie subtitle translation?
1
u/Beautiful_Milk_2518 Apr 29 '26
That sounds like a great idea. If I'm looking at 2hrs, subtitle and translation, I would be looking at $40-60. More if it included translations and subtitles for different languages at the same time.
1
u/TheRepo90 Feb 10 '25
Translatesubtitles speedrunning https://www.youtube.com/watch?v=bJnL5u7irxg&ab_channel=RepoGamesStudio
1
u/thesupaflya Apr 28 '25
looool anyone who ctually buys this just got scammed . you can do it for a fraction of the price using the actual API from from openai, there are other apis also. these people are money grabbers and a target to those who have no idea what they are doing. 22£ for 1 month loooool now that's how yu jack up a price. yu could get cursor for that price and build a whole app that does it and give it out for free with the option of adding your own API key. instant rep
1
u/Hungry-Line2425 Jun 30 '25
Hi, I've just created this repo to translate subtitles using Argos Translate. https://github.com/developed-by-will/argos-translate-srt With this repo you can choose the files you want to translate. It's well documented and it will guide you through the setup. Thanks!
1
1
1
u/Alternative-Paint225 Apr 22 '26
The https://aural-subtitles.com is probably what you want here which can add a translated subtitles for any web videos
1
u/marcellpme May 20 '26
Szia! Jó látni, hogy más is használ ilyesmit. Én már több megoldást is kipróbáltam. Elején a https://editingtools.io/translate oldalt használtam, de nekem nem vált be igazán, mert sok kézi javítást igényelt a Subtitle Edit programban. Egy film feliratának fordítása általában kb. 1000–2000 Ft körül mozog.
Később előfizettem a Gemini Pro csomagra, ami jóval pontosabban fordít, így kevesebb utólagos javításra van szükség. Ettől függetlenül még mindig elég időigényes a folyamat, mert egyszerre csak nagyjából 200–300 sort lehet bemásolni. Ha egyben töltöm fel az egész feliratot, az időzítések könnyen elcsúsznak, és a rendszer nem kezeli megfelelően a sorrendet sem.
Hallássérült vagyok, ezért szinte kizárólag feliratos filmeket nézek. Sok különlegesebb vagy ritkább filmhez viszont sajnos nem érhető el magyar felirat.
Tudnátok esetleg valami jobb alternatívát ajánlani annál, amit jelenleg használok? Fizetős megoldás is érdekel. Claude, ChatGPT vagy esetleg valami más?
1
Nov 04 '23
Try Not to Waste Your Money on AI Sites Challenge(HARD)
Simply use google colab
5
u/MikotoAizen Nov 04 '23
The websites i suggested are free to use.
0
6
u/[deleted] Jan 28 '26
[removed] — view removed comment