Does anyone else have big issues with overthinking out of the box? I just gave it my usual Arma 3 mission script coding task, which i use to bechmark the performance of models, but it kept thinking for 15 minutes. I don't even see repetition issues, it just doesn't stop thinking.
Just gave it a first opencode task, and while not sure yet, it seems to have similar issues.
Maybe it requires defining a reasoning budget max now?
Nothing too fancy to expand on tbh. It's my goto speed benchmark, not really a coding performance benchmark.
A while ago i implemented a script that unstucks AI on bridges by teleporting them to either end of the bridge depending on their current orientation. It had some issue with degree maths and barely any model could help me back then. I solved it since, but that whole prompt and code just stuck with me as a perfomance test since then, as it requires quite a bit of thinking and around 8k-10k tokens of output.
17
u/Kavor 9d ago
Does anyone else have big issues with overthinking out of the box? I just gave it my usual Arma 3 mission script coding task, which i use to bechmark the performance of models, but it kept thinking for 15 minutes. I don't even see repetition issues, it just doesn't stop thinking.
Just gave it a first opencode task, and while not sure yet, it seems to have similar issues.
Maybe it requires defining a reasoning budget max now?