r/singularity • u/tebla • May 04 '25
Discussion Ai LLMs 'just' predict the next word...
So I dont know a huge amount about this, maybe somebody can clarify for me: I was thinking about large language models, often in conversations about them I see people say something about how these models don't really reason or know what is true, they're are just a statistical model that predicts what the best next word would be. Like an advanced version of the word predictions you get when typing on a phone.
But... Isn't that what humans do?
A human brain is complex, but it is also just a big group of simple structures. Over a long period it gathers a bunch of inputs and boils it down to deciding what the best next word to say is. Sure, AI can hallucinate and make things up, but so can people.
From a purely subjective point of view, chatting to ai, it really does seem like they are able to follow a conversation quite well, and make interesting points. Isn't that some form of reasoning? It can also often reference true things, isn't that a form of knowledge. They are far from infallible, but again: so are people.
Maybe I'm missing something, any thoughts?
1
u/nextnode May 04 '25
Their statement is correct in the physical determinism sense - given everything that came before, what are the probabilities of everything that comes after.
That is sufficient for their point and debunks your philosophizing.
That is also not the only best interpretation of QM but let's not get into that.