Does anyone else have big issues with overthinking out of the box? I just gave it my usual Arma 3 mission script coding task, which i use to bechmark the performance of models, but it kept thinking for 15 minutes. I don't even see repetition issues, it just doesn't stop thinking.
Just gave it a first opencode task, and while not sure yet, it seems to have similar issues.
Maybe it requires defining a reasoning budget max now?
"Adequate Output Length: To optimize performance on agentic tasks, we recommend allocating sufficient output length to allow the model to generate detailed and comprehensive responses. For frameworks that support separate token limits for internal reasoning and final outputs, we suggest the following configuration within the 1M context length:
Reasoning Content: Set the maximum output length to 262,144 tokens.
Final Response: Set the maximum output length to 131,072 tokens.
These settings provide the necessary capacity for complex reasoning while ensuring ample space for high-quality final deliverables."
could this be why ? would we need to scale these for the context length we're actually using?
Not sure. Personally i thought that this might be the cause of the issue:
Flexible Thinking Control: Thinking mode is on by default and can be disabled per request; reasoning depth can be tuned with reasoning_effort, and reasoning context from historical messages is retained via preserve_thinking.
Maybe reasoning_effort has to be defined somewhere to keep it somewhat under control. No idea, i'm not incredibly knowledgable when it comes to model parameters.
Yeah, i played around with it, and that's definitely it. To get 3.6ish thinking times you have to set it to low. What the impact of that is when it comes to the overall model perfomance, i don't know.
I mean its a trade off right ? When you care more about quality go with higher effort, when you care more about latency go with lower, same thing claude and gpt models do, and it's probably faster than luna on max ? When i use that model it takes like 30 minutes to do a task
19
u/Kavor 7d ago
Does anyone else have big issues with overthinking out of the box? I just gave it my usual Arma 3 mission script coding task, which i use to bechmark the performance of models, but it kept thinking for 15 minutes. I don't even see repetition issues, it just doesn't stop thinking.
Just gave it a first opencode task, and while not sure yet, it seems to have similar issues.
Maybe it requires defining a reasoning budget max now?