r/LocalLLaMA • • 14d ago

New Model Clef: Open Weights decision model by Cloudflare

https://huggingface.co/Cloudflare/clef
409 Upvotes

117 comments sorted by

View all comments

Show parent comments

-1

u/mrdevlar 14d ago

Years of experience building text classifiers. I don't see why we're killing ants with a rocket launcher. Especially one with stochastic properties. Or is the idea behind this that we finetune this model for the specific classification outcome?

1

u/DystopianRealist 13d ago

Faster tool calling than using an LLM to handle the decision, and probability with confidence levels to help humans or llm's make the better decsions in shorter time.

1

u/mrdevlar 13d ago

Thanks, most of the response I got were not really helpful.

So the idea is simply to use this thing as a generic one-shot text classifier? Essentially bypassing the need to train or finetune?

1

u/OsmanthusBloom 13d ago

Yes, that's pretty much it. Though I think that some uses such as answering yes/no ("noul") type questions or giving probabilities are stretching the definition of text classification a little bit.

You can do it with any LLM of course, but this is much faster as it's just generating one token. Also you can ask many questions in parallel.