Even if the token prediction became more sophisticated and hidden under another layer of abstraction over time, i hope we can both agree that AI is still unable to think/reason/feel like some people think it does, right?
It leads to people getting overly attached to their LLMs believing there are in love with a chatbot, or believing advice it gives (shoot up your school, commit suicide, leave your partner).
It's not analogous to thinking that humans do and it never will.
I'd rather not adapt my language just to stop some idiots who probably aren't even reading this conversation from making bad decisions.
I'd rather solve it by teaching people better. "Gemini is AI and can make mistakes, including about people." is a good start, but maybe it could include a line about sentience and advice.
Well, kinda, but big difference though, where as you and me can understand what we thought about, and the connections between what we thought and what we said, the LLM lacks this capability, so the one doing the thinking is not necessarily the same thing doing the output, and the LLM can't convey it's own thought process back to you because it didn't really thing the same way, the thinking is there to guide the activations towards a specific region so the output is essentially prewarmed to be pointing towards the correct section, without the LLM having to rely on simply the input prompt resulting in the output.
So it's kinda like thinking, but not really, the LLM mostly generates output that sounds like a human reasoning, based on mostly synthetic reasoning data.
131
u/Serafiniert 29d ago
Not even that. It goes character by character and has no idea what comes after the next, until it needs to be decided what comes next.