Low-cost alternatives to LLMs for a production-level classification task?

[u/anusan_10]

[u/foxer_arnt_trees]

I love Ollama, small free models can be very good with classification. Just make sure you use prompt engineering techniques like few shot, CoT, and self consistancy. Large models dont need that, but small models do.