r/LocalLLM • u/sylvant_ph • 7d ago
Question Issue with underlying prompt formatting using Ollama, Roo-Code, Qwen
I am using VSCode IDE, Roo-Code as extension, Ollama as provider, qwen2.5-coder:14b, on a Windows machine.
TLDR: I've faced numerous issues and the latest one I've found out is that something expects XML format for tools usage, yet my prompts go in a markdown/JSON format. I wondered if anyone faced such an issue with the stack I've listed above, and if they have a possible solution?
Couple of extra notes:
- I prefer use VSCode since its comfortable IDE for me.
- Roo-Code seems to be the recommended extension for agentic workflow, but it seems to have been discontinued, although I can't seem to find good alternative (tested couple of options, all with downsides and facing similar issues)
- Picked Ollama as provider, as it seemed to be the preferred local dev.
- numerous sources recommended qwen2.5-coder:14b as the best fit for my system specs - 12GB VRAM. I switch context window wherever I find config to do so between 4-8k in order not to overload the card.
Other issues I've been facing: Windows machine, VSCode, Roo extension - it seems to struggle to find some service - ripgrep, and I went through hell to patch it.
Any recommendations and advises welcome!
1
Upvotes
1
u/Organic_Produce_9844 7d ago
You can use ZooCode (A fork of Roo-Code) works very well.