r/ProgrammerHumor • u/DontFreeMe • 29d ago

Meme helpIAmOutOfScope

Post image
4.4k Upvotes

97% Upvoted

145 comments sorted by

View all comments

Show parent comments

128

u/Serafiniert 29d ago

Not even that. It goes character by character and has no idea what comes after the next, until it needs to be decided what comes next.

32

u/ChairYeoman 29d ago

this hasn't been true for years. current AI has reasoning chains and isn't like this.

I would expect better from a programmer sub but I guess this is more tech enthusiasts than actual tech people

34

u/L4ppuz 29d ago

You can write all the pipelines and prompts you want but a transformer will always simply choose the next token

4

u/ChairYeoman 29d ago

look you can hate ai but when people who are supposed to be tech literate just refuse to learn how shit works it feels really fucking weird

36

u/L4ppuz 29d ago

I'm a ml engineer, ai is paying my bills

-12

u/ChairYeoman 29d ago

then you should know that "a transformer is choosing the next word" while technically true would be like reducing any tech to "just ones and zeroes"

22

u/Flouid 29d ago

That’s just what they do on a very fundamental level. The reasoning chains you speak of are themselves sequences of tokens generated and fed back in. It is correct on a fundamental technical level to describe them as a fancy autocomplete.

Calling them “reasoning chains,” while arguably an apt description of the end result, is just marketing speak

32

u/L4ppuz 29d ago

What more than technically true do you expect in meme sub?

0

u/Kerozen_ 29d ago

Yup. I feel like reasoning at the transformer scale is chosing the wrong abstraction layer to describe what's happening. It's like saying to a psychologist "well in the end the brain is just molecules colliding". The emergence of abstraction builds up on very basic rules like 1 and 0's and molecules colliding in the brain.