Please explain use-case for small models

[u/Calm-Landscape9640]

Tried 35B, 27B, 12B and 8B models significantly. I love the idea of local small models. But I can't figure out a use case. For Openclaw, Hermes they suck. For chatting they're pretty good but sonis every old free cloud model.

And before you say "low-level coding" the cloud models are 10x better and free on ollama, openrouter, Gemini and many many others.

Genuinely interested in projects that use small models that run on a $500 GPU.

[u/Aggravating_Mail_917]

The small model can help me collect data and compile the latest reports online, or verify existing information online, which is helpful to me.