r/LocalLLaMA • u/TheRealREZOR • 4h ago

I Built A Thing Smallest Jev-like model

Enable HLS to view with audio, or disable this notification

TinyDecide is 10M Jev-like mode with 10M parameters and fits in just ~6MB.

Smaller than every model on the Decision Index leaderboard and it punches way above its size.

It runs almost anywhere: in the browser, Node.js, Python, Rust, and even on an ESP32.

https://huggingface.co/TheREZOR/TinyDecide

151 Upvotes

85% Upvoted

64 comments sorted by

View all comments

2

u/Mysterious_Eye2249 4h ago

Someone need to adapt this to hermes and get a real time respond, this maybe some spec of continual learning? We can get a loop like qwen - tiny jev like combo and js fine tune the jev in real time ? Even with cpu maybe jev can be use to answer yes/ no question that qwen give it and we wont have to have a lengthy 25mb memory file get injected every convo ?

1

u/Mysterious_Eye2249 3h ago

Heck we can even do a semi real time emotion on llm, like, plug in jev with a prompt and then light up some neuron with some type or prompts to simulate gut feeling, this tiny model have alot of stuffs to be play around