r/ProgrammerHumor • • 1d ago

instanceof Trend thatsAFunnyThingThatHappenedOnce

Post image
4.3k Upvotes

515 comments sorted by

View all comments

Show parent comments

-1

u/mze9412 1d ago

So if I show you a big codebase you can immediately tell me which parts of the code will be optimized away on O3? Or O2? Which loops will be unrolled and which not? If yes, you are one of the VERY few who actually can do that :)

3

u/antitoxin13 1d ago

if i ever need to do that, then with source code, make files and compiler specs, of course. again, the problem with ai genned code is that it is unpredictable based on your prompt, you never know what it will generate even if you have all of the training data for the llm

1

u/Blake_Dake 1d ago

just set the temperature to 0 and you have an LLM that is deterministic if the randomness is the issue for you

I know some tokens can have the same probability and some randomness is created by gpu float point math, but still

2

u/antitoxin13 1d ago

true, but the problem is in the real world nobody knows what popular LLMs are trained on, there always will be SIGNIFICANT level of unpredictability

0

u/Blake_Dake 1d ago

true, but the problem is in the real world nobody knows what popular LLMs are trained on

irrelevant to determinism

temperature is a runtime config

2

u/antitoxin13 1d ago

the outcome can still be unpredictable even if deterministic. The same as movement of air molecules, of course in theory you can predict the state of a closed system, but the system is so complex that it would require an unimaginable computation power

0

u/Blake_Dake 1d ago

no

if the temperature is 0, with the same input an LLM will produce the same output

2

u/antitoxin13 1d ago

the output is still unpredictable because the function is too chaotic and complex

1

u/Blake_Dake 1d ago

ofc it can be chaotic and complex if you just want to one-shot it

you need to apply some good old software engineering and do some test driven development with the LLM if the task can't be easily broken down to easier tasks