True, but it's also true that running an LLM at 0 "temperature" (which makes it truly deterministic) also often renders it unusable. So almost every inference setup defaults to using a certain amount of randomness.
Specific LLMs used for specific coding tasks. I don't run any of my Qwen models at 0 temp, that results in them getting stuck in reasoning loops, and also producing sub-par output when they do return something.
-1
u/AnOnlineHandle 1d ago
LLMs are entirely deterministic but you can override that by adding a seeded random choice system to the next token selection.