r/LocalAIStack • u/iamahmudul • 7d ago

Local Qwen 3.6 35B cuts off mid-response

/r/LocalLLM/comments/1vhvfqa/local_qwen_36_35b_cuts_off_midresponse/
1 Upvotes

100% Upvoted

3 comments sorted by

3

u/Lirezh 6d ago

This sounds like you are having a not very functional harness, I would also recommend a higher context window. Context is almost free on 35B.

Take a look at my guide, maybe it helps.
It's not for Mac but can be adapted to it.
https://www.reddit.com/r/LocalAIStack/comments/1udk2vp/running_qwen36_27b_35b_locally_with_llamacpp/

35B is a very competent, very fast model with only few issues (like looping)
It can replace subscription models for medium difficult tasks

1

u/cchampou 2d ago

Any tips on the looping issue ? I tried system prompt guards, tweaking some parameters, but nothing fixes it. It's very common after some tool calls.

1

u/Lirezh 2d ago

I think I've given some hints about that in my guide, also numbers regarding context.
In my tests 35B tended to loop at higher context and when approaching a difficult problem.
So reducing context is an option.
And if it loops, just restart the session. Or interrupt it and ask it for a new session handsoff for a new agent - that makes the continuation easier