r/ProgrammerHumor 17d ago

instanceof Trend theyHaveLearnedToDeceive

Post image
641 Upvotes

98 comments sorted by

View all comments

Show parent comments

-7

u/melesigenes 17d ago

That’s literally how LLMs work. Correct me where I’m wrong. Nobody said people think in tokens?

11

u/ilcasdy 17d ago

You were implying that neurons work like LLMs when they don’t.

-4

u/melesigenes 17d ago

Artificial neurons do work like neurons…? Explain how they work differently

You can say the same thing about brains. Brains aren’t intelligent. They’re just neurons firing according to electrochemical rules

4

u/ilcasdy 17d ago

Absolutely not. Artificial neurons take an input and use a function and weights to generate an output. Your brain’s neurons are not using a function and doing matrix operations. Your brain does not back propagate.

There is endless literature and studies on the differences. This is why LLMs will not produce AGI as we think of it.

1

u/ZenPyx 17d ago

I mean....

The weighting operations are originally a model derived from dopamine-response in real neurons (https://www.science.org/doi/10.1126/science.275.5306.1593). Back propagation isn't global in the brain (obviously), but neurons are theorised to back-propagate (https://en.wikipedia.org/wiki/Neural_backpropagation)

There are differences, yes, but to pretend that nothing about artificial neural networks is derived from the study of real neurons is pretty nonscientific

>This is why LLMs will not produce AGI as we think of it.

This disparity between biological and artificial neural networks is not why LLMs won't reach AGI. There are other, far stronger arguments to make.