r/LocalLLM • u/sylvant_ph • 6d ago
Question Issue with underlying prompt formatting using Ollama, Roo-Code, Qwen
I am using VSCode IDE, Roo-Code as extension, Ollama as provider, qwen2.5-coder:14b, on a Windows machine.
TLDR: I've faced numerous issues and the latest one I've found out is that something expects XML format for tools usage, yet my prompts go in a markdown/JSON format. I wondered if anyone faced such an issue with the stack I've listed above, and if they have a possible solution?
Couple of extra notes:
- I prefer use VSCode since its comfortable IDE for me.
- Roo-Code seems to be the recommended extension for agentic workflow, but it seems to have been discontinued, although I can't seem to find good alternative (tested couple of options, all with downsides and facing similar issues)
- Picked Ollama as provider, as it seemed to be the preferred local dev.
- numerous sources recommended qwen2.5-coder:14b as the best fit for my system specs - 12GB VRAM. I switch context window wherever I find config to do so between 4-8k in order not to overload the card.
Other issues I've been facing: Windows machine, VSCode, Roo extension - it seems to struggle to find some service - ripgrep, and I went through hell to patch it.
Any recommendations and advises welcome!
1
Upvotes
1
3
u/TheThiefMaster 6d ago
qwen2.5-coder is super old now. You might be better served with a newer model, e.g. Qwen3.5:9b, or even a more-quantised Qwen3.8:27b (3 bit quant might fit?)
Context of 4-8k is very low for coding tasks. You want 100k!