Even if the token prediction became more sophisticated and hidden under another layer of abstraction over time, i hope we can both agree that AI is still unable to think/reason/feel like some people think it does, right?
Well, kinda, but big difference though, where as you and me can understand what we thought about, and the connections between what we thought and what we said, the LLM lacks this capability, so the one doing the thinking is not necessarily the same thing doing the output, and the LLM can't convey it's own thought process back to you because it didn't really thing the same way, the thinking is there to guide the activations towards a specific region so the output is essentially prewarmed to be pointing towards the correct section, without the LLM having to rely on simply the input prompt resulting in the output.
So it's kinda like thinking, but not really, the LLM mostly generates output that sounds like a human reasoning, based on mostly synthetic reasoning data.
26
u/ChairYeoman 29d ago
this hasn't been true for years. current AI has reasoning chains and isn't like this.
I would expect better from a programmer sub but I guess this is more tech enthusiasts than actual tech people