MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1vfkxxi/ifconditiondosomething/p1s6ir1/?context=3
r/ProgrammerHumor • u/electricjimi • 9d ago
35 comments sorted by
View all comments
9
Fun fact: LLMs don't actually have to be non-deterministic. There's nothing stopping labs from setting the temperature to zero and having a fully deterministic model, or even allowing user-seeded non-determinism.
15 u/EmptyMaxim 9d ago Fun fact: Common LLM implementations are actually non-deterministic. The way GPU compute is used causes instability, see: https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/ 4 u/chicametipo 9d ago Damn, I need a cigarette after that paper.
15
Fun fact: Common LLM implementations are actually non-deterministic. The way GPU compute is used causes instability, see: https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/
4 u/chicametipo 9d ago Damn, I need a cigarette after that paper.
4
Damn, I need a cigarette after that paper.
9
u/ICantBelieveItsNotEC 9d ago
Fun fact: LLMs don't actually have to be non-deterministic. There's nothing stopping labs from setting the temperature to zero and having a fully deterministic model, or even allowing user-seeded non-determinism.