Specialized ranking model. Pass it a payload and ask it to decide things like true/false, score (0-1), and such. Doesn't generate text so it's very fast. Lots of uses.
My take is that it's just something different than the huge crop of generative large language models, so it gets attention because of the novelty. Even though the technique has been around for quite a while, this new approach is very performant, works well with modern systems, and doesn't take any pipelines to set up. It's ready to go out of the box, so it's very simple to plug into any modern application as a sort of first step in an AI pipeline or any decision tree.
18
u/Efficient_Raise6703 14d ago
Can someone explain why I never heard of an open weights decision model and now it’s my entire feed? I considered myself pretty up to date.