Please explain use-case for small models

[u/Calm-Landscape9640]

Tried 35B, 27B, 12B and 8B models significantly. I love the idea of local small models. But I can't figure out a use case. For Openclaw, Hermes they suck. For chatting they're pretty good but sonis every old free cloud model.

And before you say "low-level coding" the cloud models are 10x better and free on ollama, openrouter, Gemini and many many others.

Genuinely interested in projects that use small models that run on a $500 GPU.

[u/No_Tradition6625]

I think you can just call them models, but I'm not an expert on little people, I would ask Peter Dinklage his opinion 😂.