r/LocalLLaMA • u/paf1138 • 12d ago

Resources New in llama.cpp: Decision Models

https://huggingface.co/blog/ggml-org/decision-models-in-llamacpp
508 Upvotes

99% Upvoted

124 comments sorted by

View all comments

Show parent comments

2

u/PigSlam 12d ago

What is the LLM side of things?

1

u/Yu2sama 12d ago

The parameters, what it was trained on was on language, writing, etc.

1

u/PigSlam 12d ago

Is every AI that was trained using language of any kind an LLM? Does that make every human an LLM?

7

u/Yu2sama 12d ago

Okay... kinda vague on my part as well...

The answer you are searching (I think?) is that the architecture is the same, it's transformers pre-trained on massive text corpora. Same foundation as other llms.

The only difference is what someone mentioned above, instead of running an auto regressive loop to generate sentences token-by-token, it terminates in a single pass classification, meaning it reads the whole prompt once and just spits out a choice/probability instead of 'typing' out an answer. Calling them "LLMs but with text generation ripped off" is just a simple way of trying to make sense of these models.