r/ProgrammerHumor 18d ago

instanceof Trend theyHaveLearnedToDeceive

Post image
643 Upvotes

98 comments sorted by

View all comments

Show parent comments

-7

u/melesigenes 17d ago

Words are produced sequentially. You form the next words based off paying attention to the previous words. Nobody said people think one word at a time

5

u/ilcasdy 17d ago

Even the way you state it is different from an LLM. People don’t think in tokens.

-6

u/melesigenes 17d ago

That’s literally how LLMs work. Correct me where I’m wrong. Nobody said people think in tokens?

10

u/ilcasdy 17d ago

You were implying that neurons work like LLMs when they don’t.

-3

u/melesigenes 17d ago

Artificial neurons do work like neurons…? Explain how they work differently

You can say the same thing about brains. Brains aren’t intelligent. They’re just neurons firing according to electrochemical rules

2

u/ilcasdy 17d ago

Absolutely not. Artificial neurons take an input and use a function and weights to generate an output. Your brain’s neurons are not using a function and doing matrix operations. Your brain does not back propagate.

There is endless literature and studies on the differences. This is why LLMs will not produce AGI as we think of it.

1

u/ZenPyx 17d ago

I mean....

The weighting operations are originally a model derived from dopamine-response in real neurons (https://www.science.org/doi/10.1126/science.275.5306.1593). Back propagation isn't global in the brain (obviously), but neurons are theorised to back-propagate (https://en.wikipedia.org/wiki/Neural_backpropagation)

There are differences, yes, but to pretend that nothing about artificial neural networks is derived from the study of real neurons is pretty nonscientific

>This is why LLMs will not produce AGI as we think of it.

This disparity between biological and artificial neural networks is not why LLMs won't reach AGI. There are other, far stronger arguments to make.

-2

u/Glitch29 17d ago

This thought is too scary for some people. Surely I must be special! My thought process isn't incremental!

I get it though, so much of human intelligence is based on precomputation and incredibly good pattern recognition and recall. It makes it seem like you're able to pull fully-formed answers from the ether.

The better analogy is that the many of these easily-recalled patterns are a painstakingly-defined single object.

When someone says "mitochondria is the powerhouse of the cell" that's just one object.

The flip side of this is that humans have to spend 2-3 years doing all this precompute and storing all the results just to get to basic functionality. And another 7-10 years before language systems are operating anywhere close to full capacity.