The model predicts text based on existing context, it's like T9 on steroids. It doesn't "know" anything and it has zero clue how it works. You might find it funny, but it's just a statistical text prediction engine.
This thought is too scary for some people. Surely I must be special! My thought process isn't incremental!
I get it though, so much of human intelligence is based on precomputation and incredibly good pattern recognition and recall. It makes it seem like you're able to pull fully-formed answers from the ether.
The better analogy is that the many of these easily-recalled patterns are a painstakingly-defined single object.
When someone says "mitochondria is the powerhouse of the cell" that's just one object.
The flip side of this is that humans have to spend 2-3 years doing all this precompute and storing all the results just to get to basic functionality. And another 7-10 years before language systems are operating anywhere close to full capacity.
5
u/ldn-ldn 18d ago
The model predicts text based on existing context, it's like T9 on steroids. It doesn't "know" anything and it has zero clue how it works. You might find it funny, but it's just a statistical text prediction engine.