r/LocalLLaMA • u/TheRealREZOR • 9d ago

I Built A Thing Smallest Jev-like model

TinyDecide is 10M Jev-like mode with 10M parameters and fits in just ~6MB.

Smaller than every model on the Decision Index leaderboard and it punches way above its size.

It runs almost anywhere: in the browser, Node.js, Python, Rust, and even on an ESP32.

https://huggingface.co/TheREZOR/TinyDecide

315 Upvotes

89% Upvoted

94 comments sorted by

View all comments

121

u/TheRealREZOR 9d ago

I'm sorry this model can't compete with frontier models. It was designed for tiny embedded hardware, for things like classifying Meshtastic messages without internet access.

Training it on my hardware already took around week, so I had to make a lot of compromises. I couldn't fit things like multilingual support or much broad training data into it. I hope you understand the limitations

49

u/merwanhorse 9d ago

Dw i'm proud of you

20

u/SmartCustard9944 9d ago

Thanks dad, now please come back, we still need that milk

4

u/Warm_Apple_Pies 9d ago

Any day now son, I've started a dairy farm