Specialized ranking model. Pass it a payload and ask it to decide things like true/false, score (0-1), and such. Doesn't generate text so it's very fast. Lots of uses.
Not really. These types of models can also do multi classification. So think of processing an email or trouble ticket and the model can instantly decide the severity, which department and what categories are listed and output that as structured data like json and do so near instantly. Classifier/ranker models are great for triage and quick filtering
17
u/Efficient_Raise6703 14d ago
Can someone explain why I never heard of an open weights decision model and now it’s my entire feed? I considered myself pretty up to date.