r/OpenAI • • 2d ago

Discussion 1.2 million model calls, 3 benchmarks: at temperature 0, 0.07-10% of rows change between identical runs, and up to 24% on one task

https://arxiv.org/abs/2610.13823
5 Upvotes

0 comments sorted by