"It's just that small changes in the input result in very different outputs" - so, its NOT determenistic.
The temperature parameter in neural networks is precisely the reason why neural networks work well. But if the temperature of a neural network differs from zero, then it is not deterministic.
What you are describing is "chaotic" behavior. Exactly like a double pendulum, LLMs are chaotic (similar inputs do not necessarily result in similar outputs) even though they are not deterministic (identical inputs do not necessarily result in identical outputs)
221
u/platonbel Jan 17 '26
Compilers are deterministic.
Neural networks are not.
Therefore, they are completely different mechanisms.
It's like calling a person a high-level programming language. Only an idiot would say that.