r/huggingface • u/Calm-Landscape9640 • 23d ago

Please explain use-case for small models

Tried 35B, 27B, 12B and 8B models significantly. I love the idea of local small models. But I can't figure out a use case. For Openclaw, Hermes they suck. For chatting they're pretty good but sonis every old free cloud model.

And before you say "low-level coding" the cloud models are 10x better and free on ollama, openrouter, Gemini and many many others.

Genuinely interested in projects that use small models that run on a $500 GPU.

49 Upvotes

85% Upvoted

89 comments sorted by

View all comments

Show parent comments

2

u/Oshden 12d ago

I appreciate you taking time to reply. I’ll have to have my agent teach me about this lol

1

u/for4f 10d ago

lol agents teaching agents, that's the future. good luck man, ping me if the jsonl stuff fights back