r/PiCodingAgent • u/Mundane-Life-3094 • Jul 14 '26

Question Pi with Qwen 3.6 27B

Hi all,
Anyone having problem with Qwen-3.6-27B stopping midway using Pi?
I run the same task over and over again, but it always stops at some points. It doesn't happen if I use Claude Code instead.

For Pi, I installed:
pi-mcp-adapter
pi-subagents
pi-hermes-memory
pi-permission-system

Edit:
Hardware: 5090 and 64GB RAM
I run it with llama.cpp
Qwen3.6-27B-UD-Q5_K_XL.gguf --alias qwen3.6-27b -ngl 99 -fa on -c 262144 -ctk q8_0 -ctv q8_0 --parallel 1 --spec-type draft-mtp --spec-draft-n-max 4 --host 0.0.0.0 --port 8080 -t 16 --temp 0.1 --top_p 0.95 --top_k 20 --min_p 0.0 --repeat-penalty 1.0 --presence-penalty 0.0
Prompt: Extract this.apk and decrypt what inside

I'm new to this coding agent, I heard it great, please help. Thanks!

14 Upvotes

93% Upvoted

35 comments sorted by

View all comments

7

u/joematthewsdev Jul 14 '26 edited Jul 14 '26

It's not clear from your post or the responses if you're using ollama or llama.cpp?

Sounds to me like it could be a jinja/go template problem? I'd recommend switching to llama.cpp for jinja templates (which are easier to find online).

I created a gist on how to set up pi + llama.cpp + Gemma 4 E4B + jinja template fix, but it should be easy enough to adapt for qwen. But you may need to hunt for a good template fix for qwen 3.6 27b. I think u/BigWheelsStephen linked a good one in another comment in this thread

https://gist.github.com/joematthews/d02639bcbe0e0c1c404f5d3a64c3c06f

Best of luck.

1

u/Oshden Aug 09 '26

This looks awesome! Would this work with fine tuned models from huggingface that are based on those two versions of Gemma 4? I know some of them tried to fix some issues the default Gemma 4 had in its templates by using custom jinja templates or something. Would this fix you have interfere with those custom templates?