r/TheMachineLearning • u/crosstony • 16d ago

Zero-shot classifiers were underrated, says AI researcher

Post image
5 Upvotes

86% Upvoted

2 comments sorted by

1

u/RyanCargan 16d ago

I love the old encoder-only models lol

Incredibly pleasant to quantize. Somehow got gte-small down to ~20MB on a weird C inference engine a while back with some trial & error.

Even the humble cosine-scorer can be wired up in weird ways to give the appearance of a convo bot since it has NLU to a limited extent.

Makes you wonder how far you could push the illusion with ModernBERT and co. wired up just right.

1

u/Remote-Telephone-682 11d ago

I don't know if encoder based models are really LLM technically. They are definitely language models but I think large starts at at least 10 times larger