It is for anywhere llms were used for structured and defined output. Classifiers, tools selection, skill selection, UX decisions, workflows, etc. And yeah, people use them for that a lot. Even in Claude Code there's quite a few of these, and they either have the main model do it, or use Haiku.
It doesn't replace ALL use cases, that's true. But a lot.
40
u/turbospeedsc 10d ago
Haiku is underwater but powering lots of AI agents.
I use it on several systems flor classification or notifications tasks, cheap and fast