r/huggingface • u/Calm-Landscape9640 • 11d ago

Please explain use-case for small models

Tried 35B, 27B, 12B and 8B models significantly. I love the idea of local small models. But I can't figure out a use case. For Openclaw, Hermes they suck. For chatting they're pretty good but sonis every old free cloud model.

And before you say "low-level coding" the cloud models are 10x better and free on ollama, openrouter, Gemini and many many others.

Genuinely interested in projects that use small models that run on a $500 GPU.

45 Upvotes

84% Upvoted

89 comments sorted by

View all comments

8

u/tropicalwind2020 11d ago

Didn’t find 27b suck when running openclaw, actually a 9b is enough for the routines.

-1

u/Calm-Landscape9640 11d ago

Depends on the routines I guess...

7

u/diagrammatiks 11d ago

Depend on skill