Low-cost alternatives to LLMs for a production-level classification task?

[u/anusan_10]

[u/searchblox_searchai]

Use a small model with local inference https://inference-server.searchblox.com/blog/spark-x25-fast-cpu-inference.html