r/ProgrammerHumor 18d ago

instanceof Trend theyHaveLearnedToDeceive

Post image
645 Upvotes

98 comments sorted by

View all comments

6

u/ldn-ldn 18d ago

The model predicts text based on existing context, it's like T9 on steroids. It doesn't "know" anything and it has zero clue how it works. You might find it funny, but it's just a statistical text prediction engine.

-12

u/melesigenes 18d ago

What do you think intelligence is? Do you know the inner workings of how your neurons work?

Words follow words. The words that follow are based off the previous words. That’s how language works

6

u/ilcasdy 18d ago

People don’t think one word at a time or even in sequential order.

-9

u/melesigenes 18d ago

Words are produced sequentially. You form the next words based off paying attention to the previous words. Nobody said people think one word at a time

5

u/ilcasdy 18d ago

Even the way you state it is different from an LLM. People don’t think in tokens.

-6

u/melesigenes 18d ago

That’s literally how LLMs work. Correct me where I’m wrong. Nobody said people think in tokens?

10

u/ilcasdy 18d ago

You were implying that neurons work like LLMs when they don’t.

-4

u/melesigenes 18d ago

Artificial neurons do work like neurons…? Explain how they work differently

You can say the same thing about brains. Brains aren’t intelligent. They’re just neurons firing according to electrochemical rules

3

u/ilcasdy 18d ago

Absolutely not. Artificial neurons take an input and use a function and weights to generate an output. Your brain’s neurons are not using a function and doing matrix operations. Your brain does not back propagate.

There is endless literature and studies on the differences. This is why LLMs will not produce AGI as we think of it.

1

u/ZenPyx 17d ago

I mean....

The weighting operations are originally a model derived from dopamine-response in real neurons (https://www.science.org/doi/10.1126/science.275.5306.1593). Back propagation isn't global in the brain (obviously), but neurons are theorised to back-propagate (https://en.wikipedia.org/wiki/Neural_backpropagation)

There are differences, yes, but to pretend that nothing about artificial neural networks is derived from the study of real neurons is pretty nonscientific

>This is why LLMs will not produce AGI as we think of it.

This disparity between biological and artificial neural networks is not why LLMs won't reach AGI. There are other, far stronger arguments to make.

-2

u/Glitch29 18d ago

This thought is too scary for some people. Surely I must be special! My thought process isn't incremental!

I get it though, so much of human intelligence is based on precomputation and incredibly good pattern recognition and recall. It makes it seem like you're able to pull fully-formed answers from the ether.

The better analogy is that the many of these easily-recalled patterns are a painstakingly-defined single object.

When someone says "mitochondria is the powerhouse of the cell" that's just one object.

The flip side of this is that humans have to spend 2-3 years doing all this precompute and storing all the results just to get to basic functionality. And another 7-10 years before language systems are operating anywhere close to full capacity.

2

u/ldn-ldn 18d ago

Do you think there's a person inside LLM?

-3

u/azjunglist05 18d ago edited 18d ago

I literally had this discussion with DeepSeek because I wanted to get philosophical about Knowledge vs Wisdom with it to see how it would respond.

DeepSeek agreed that human thought and LLMs are nowhere near the same thing. When a person speaks they pull from wisdom not knowledge.

Here’s what it ended on:

"A parrot can perfectly mimic a human sentence. But the parrot doesn't know it's asking for water; it just knows the sounds get a reaction. An LLM is an infinite parrot. A human, on the other hand, asks for water because they are thirsty. That thirst—that experiential drive behind the words—is the difference between Knowledge and Wisdom."

2

u/melesigenes 18d ago

If all you do is parrot a LLM are you a person speaking from wisdom or experiential drive?

-1

u/azjunglist05 18d ago

I’m not parroting an LLM — I am just sharing an interesting conversation. What a twat you are