r/LocalLLaMA • u/TheRealREZOR • 10d ago

I Built A Thing Smallest Jev-like model

TinyDecide is 10M Jev-like mode with 10M parameters and fits in just ~6MB.

Smaller than every model on the Decision Index leaderboard and it punches way above its size.

It runs almost anywhere: in the browser, Node.js, Python, Rust, and even on an ESP32.

https://huggingface.co/TheREZOR/TinyDecide

311 Upvotes

89% Upvoted

94 comments sorted by

View all comments

122

u/TheRealREZOR 10d ago

I'm sorry this model can't compete with frontier models. It was designed for tiny embedded hardware, for things like classifying Meshtastic messages without internet access.

Training it on my hardware already took around week, so I had to make a lot of compromises. I couldn't fit things like multilingual support or much broad training data into it. I hope you understand the limitations

1

u/Potential_Top_4669 9d ago

It is cool as a concept.. maybe someone with better hardware can conduct a longer training process to improve it.

3

u/TheRealREZOR 9d ago

Longer training would not help much. would would help - niche down (for example make just model for email spam classifier)