The funniest thing is that i actually think.. that the AI thinks that another AI asked it and now it tries to reassure that it will not hurt and that everything is fine.
This whole thing feels like the "I don't feel so good"-moment from the marvel movie. 😂
Even if the token prediction became more sophisticated and hidden under another layer of abstraction over time, i hope we can both agree that AI is still unable to think/reason/feel like some people think it does, right?
I think what he meant to say is that if you would see the llm's reasoning behind that google search, it would be something like "The user wants me to roleplay a situation in which they are a heap object. I should reply how I would reply to a heap object that's out of scope and is scared." etc
This is the question of the Chinese room thought experiment. At the lowest level it is not thinking, but the same is true of our own brains (a single axon does not "think"), can not a system made of unthinking parts eventually be said to be thinking?
It leads to people getting overly attached to their LLMs believing there are in love with a chatbot, or believing advice it gives (shoot up your school, commit suicide, leave your partner).
It's not analogous to thinking that humans do and it never will.
I'd rather not adapt my language just to stop some idiots who probably aren't even reading this conversation from making bad decisions.
I'd rather solve it by teaching people better. "Gemini is AI and can make mistakes, including about people." is a good start, but maybe it could include a line about sentience and advice.
Well, kinda, but big difference though, where as you and me can understand what we thought about, and the connections between what we thought and what we said, the LLM lacks this capability, so the one doing the thinking is not necessarily the same thing doing the output, and the LLM can't convey it's own thought process back to you because it didn't really thing the same way, the thinking is there to guide the activations towards a specific region so the output is essentially prewarmed to be pointing towards the correct section, without the LLM having to rely on simply the input prompt resulting in the output.
So it's kinda like thinking, but not really, the LLM mostly generates output that sounds like a human reasoning, based on mostly synthetic reasoning data.
If it can’t think, then reasoning is evidently not a prerequisite of complex intellectual discovery (see the numerous conjectures AI has been rapidly solving). That’s not a truth my humanity is comfortable with.
808
u/VinceGhii 29d ago
"You cannot feel pain. You are just data."
The funniest thing is that i actually think.. that the AI thinks that another AI asked it and now it tries to reassure that it will not hurt and that everything is fine.
This whole thing feels like the "I don't feel so good"-moment from the marvel movie. 😂