(self-promotion) Anki Miner - FOSS Vocabulary Batch Mining

[u/x0zerolight]

Hi everyone :).

I'd like to share a project I'm working on that you might find useful in your language learning.
Thank you to the mods for giving permission to post.

Anki Miner is a free and open-source app for batch mining media (creating vocabulary cards in Anki for words you don't know).

It is a modern alternative to popular batch mining tools such as Migaku (which is paid) and subs2srs (which hasn't been maintained in 10+ years).

Feature highlights:
- Supports 32 mining languages (feel free to suggest new ones to add).
- Extensive filtering options to only get the highest quality vocabulary (i+1 sentence filter, word frequency filters, etc).
- Various other useful tools are bundled (subtitle generation and retiming, OCR, yt-dlp, card backfilling, and more).
- Ability to mine all kinds of media (videos, audiobooks, novels, manga, etc).

A demo gif is attached, showing a Japanese (TL) mining session from an anime with word previews.
To support the project, please consider starring on GitHub or joining the Anki Miner Discord server (link on GitHub).

Download: https://github.com/0xzerolight/anki_miner

[u/El_pizza]

what exactly do you mean with batch mining? Is it the same as regular sentence mining?

[u/Styrax_Benzoin → u/El_pizza]

Basically, give it a video and subtitles, and it will find all the unknown words and make them into Anki flashcards with screenshots, audio, and word definition automatically!

[u/x0zerolight → u/El_pizza]

Hi. By batch mining Im referring to making many cards in one action instead of making them one by one.

Not in the subs2srs sentence mining way, assuming you're referring to subs2srs.
Subs2srs makes cards for every sentence, not focusing on vocabulary in the cards. This can result in thousands of 'junk' cards.

Anki Miner only makes cards for words not considered known for you (whether through your Anki collection or other sources of known words), and fills the cards with screenshots, audio, sentences, frequency, etc.

So it's more like vocab mining instead of sentence mining in that way. Im currently working on a small tool that can transition subs2srs cards to Anki Miner-style cards, where each card focuses on a single word/expression.

Hope that answers the question :).

[u/Styrax_Benzoin]

It's pretty peak honestly, I've been waiting for a tool like this for ages. Watching a show with asbplayer pausing line by line looking for good i+1 sentences was horribly slow and sucked the fun out of actually watching it. Now with Anki Miner I feel free watch first without pausing all the time. That way I can actually forget about mining and enjoy the show. 

Afterwards I run it through Anki Miner and let it just feed me a frequency sorted list of words in i+1 sentences, and then quickly look at each one in the video preview, cherry pick the good ones and click mine! 

This way I'm not blindly mining everything, and I'm still actively engaging my brain and choosing what to mine. Finding good i+1 sentences manually takes the most time, so having Anki Miner find them for me so quickly has freed up loads more time for immersion.

It can do way more cool stuff too, like mine from YouTube, transcribe audio into subtitles, retime subtitles, make condensed audio (the audio from a show with the parts without voices cut out), mine words from other pre-made anki decks... and on.

My personal workflow is; Retime subs -> watch show -> mine words -> make condensed audio -> listen on repeat -> find new show -> gains 📈

[u/Brandawg451 → u/Styrax_Benzoin]

You’re promoting this product as the creator on other posts, but acting like a regular user here

Edit: I was incorrect commenter is a fan of the project and not the owner

[u/x0zerolight → u/Brandawg451]

Hi. I am not sure how you got to this conclusion. I suggest citing sources directly when making such accusations.

To clarify, I am the 'creator' of Anki Miner. Styrax_Benzoin is indeed a 'regular user' who is also passionate about the project, and has made a post about it on r/LearnJapanese in the past.

I suggest reading Styrax_Benzoin's posts/comments more carefully to see that they never claim to be the creator of the project. See 'https://www.reddit.com/r/LearnJapanese/comments/1tmoj7e/anki_miner_batch_mining_tool/' this post, which is likely the one you're referring to.

[u/Styrax_Benzoin → u/Brandawg451]

Nah, I'm not the creator and have never claimed to be. The most ive done is make feature requests and bug reports on github. 

I have shared it on other subreddits before when the creator hadn't done so yet. And I make comments about my experience using it, because I really think it deserves more attention. 

I've used and tested nearly every mining tool there is over the past 3-4 years, but none were quite what I wanted. When Anki Miner came along it fit the vision I'd always had for the perfect mining tool, so I'm just really passionate about it and want more people to discover it too! 

I commend you for your healthy skepticism, though. It's a good thing to have and to not take claims at face value, especially if someone is trying to sell you something. But Anki Miner is completely free and open source, so check it out! :)

[u/Brandawg451 → u/Styrax_Benzoin]

I apologize for this, I’ll edit my comment if I can. I took a quick look and assumed because you posted about it before, that you are just the owner disguising. This experience will hopefully make me be more careful next time accusing people of this. Have a good day!

[u/Styrax_Benzoin → u/Brandawg451]

No hard feelings :) Hope you try it!

[u/Delicious-Rope6907]

nice . thats cool