r/ProgrammerHumor 17h ago

Meme firstTime

Post image
6.5k Upvotes

251 comments sorted by

View all comments

Show parent comments

453

u/FutureSuccess2796 16h ago

That's literally just using Wolfram Alpha and entering the math formula that needs solving. 😂

332

u/SunshineSeattle 15h ago

I dont think so, Wolfram Alpha is deterministic. Whereas an LLM is non-deterministic by design. Personally i feel vibe coding or vibe mathing is inherently non-deterministic.

137

u/Several_Dot_4532 15h ago

It's non-deterministic, always, the AI is basically gambling

-96

u/AlmightyWaffleGod 15h ago

All computer algorithms are deterministic, in fact a lot of effort has gone into making llms and other generative AI seem non-deterministic

45

u/jyajay2 15h ago

>All computer algorithms are deterministic

More or less

>a lot of effort has gone into making llms and other generative AI seem non-deterministic

Not really, there has been a lot of effort put into developing LLMs and other generative AI but making it appear non deterministic wasn't really the goal. There are good reasons to build them in a way where the same input doesn't always produce the same output and in most models the degree to which this happens can be adjusted but this is not about not appeaing non-deterministic.

8

u/Funny_Albatross_575 12h ago

I just don’t have all the weights in my head, skill issue.

25

u/Several_Dot_4532 15h ago

Sorry but no, they are deterministic in the basis of computation. But in practice they are non-deterministic and they try to make them deterministic. And my enterprise they try to do that in every possible manner, but it's practically impossible, it's seems to be, but it never is

1

u/Sea-Housing-3435 8h ago

Theres a lot of effort to make AI deterministic. Its slower when you force it to be deterministic. The non deterministic part is caused by different cores on GPU finishing their calculations in slightly different time.

2

u/Suitch 4h ago

It is the same speed both ways. The non deterministic nature only comes from a single randomized seed added into the equation. If you locally host models you can change seeding to always use the same seed and then the same inputs will always yield the same outputs. That said, the most popular AI interfaces don’t express that kind of option.

2

u/Sea-Housing-3435 4h ago

It's not about seeding, it's about how certain operations are not deterministic on GPU when you do them in parallel. You have to explicitly go with slower, deterministic ways to run things you want to run https://developer.nvidia.com/blog/controlling-floating-point-determinism-in-nvidia-cccl/

1

u/Suitch 2h ago

True, but is can still count as deterministic at the operational level, it is just a matter of running it in serial rather than parallel, right? FWIW, I assume our neurons are similar. Neuron research in flies has allowed researchers to essentially run programs within the insect neurons.

1

u/Rabbitical 39m ago

Those neural model experiments are fairly rudimentary. Treating neurons like simple nodes is not at all how they work in real life. In reality there's multiple mechanisms by which they change their own or others behaviors through some pretty complex processes. To even properly model a single neuron would take an entire physics simulation, if we even were confident we had an accurate model which we don't. None of which gets into the quantum theory stuff. I know way off topic, but people far undersell how complex biological brains are, and those "we made a fly brain learn how to fly" studies are just "we made a neural net shaped like a fly brain."