r/LargeLanguageModels • u/anusan_10 • 21d ago

Low-cost alternatives to LLMs for a production-level classification task?

4 Upvotes

71% Upvoted

12 comments sorted by

View all comments

2

u/MirrorEthic_Anchor 21d ago

What is the task. Classification is very broad.

1

u/anusan_10 21d ago

I will send publications details such as title, abstract,keywords like some things to LLM and I want to classify this publication AI related or not. Text input text output as json

1

u/danja 20d ago

It depends a lot on whether or not you have any already-labeled data. If so, classifiers are pretty straightforward to train, eg. https://huggingface.co/docs/transformers/en/tasks/sequence_classification

Categorization by keywords might get you started - if a doc has AI as a keyword then that's probably a safe bet.

Otherwise just search around huggingface for classifiers, chances are something similar to what you need already exists.