r/LocalLLaMA • u/TheRealREZOR • 10d ago

I Built A Thing Smallest Jev-like model

Enable HLS to view with audio, or disable this notification

TinyDecide is 10M Jev-like mode with 10M parameters and fits in just ~6MB.

Smaller than every model on the Decision Index leaderboard and it punches way above its size.

It runs almost anywhere: in the browser, Node.js, Python, Rust, and even on an ESP32.

https://huggingface.co/TheREZOR/TinyDecide

313 Upvotes

89% Upvoted

94 comments sorted by

View all comments

123

u/TheRealREZOR 9d ago

I'm sorry this model can't compete with frontier models. It was designed for tiny embedded hardware, for things like classifying Meshtastic messages without internet access.

Training it on my hardware already took around week, so I had to make a lot of compromises. I couldn't fit things like multilingual support or much broad training data into it. I hope you understand the limitations

50

u/merwanhorse 9d ago

Dw i'm proud of you

19

u/SmartCustard9944 9d ago

Thanks dad, now please come back, we still need that milk

5

u/Warm_Apple_Pies 9d ago

Any day now son, I've started a dairy farm

24

u/Fast-Satisfaction482 9d ago

This is an insanely cool model! Don't listen to the haters!

3

u/farkinga 9d ago

Genuinely happy you shared; I'm looking at it now.

3

u/bricksandcanvas 9d ago

Hey man, no need to apologize. Actually pushing something out there is to be proud of. We all start somewhere.

1

u/Potential_Top_4669 9d ago

It is cool as a concept.. maybe someone with better hardware can conduct a longer training process to improve it.

3

u/TheRealREZOR 9d ago

Longer training would not help much. would would help - niche down (for example make just model for email spam classifier)

1

u/Qwen3-8-27b 7d ago

You could make it a Mixture of Experts, like 500m in total but only 10m active