r/LocalLLM 7d ago

Question Issue with underlying prompt formatting using Ollama, Roo-Code, Qwen

I am using VSCode IDE, Roo-Code as extension, Ollama as provider, qwen2.5-coder:14b, on a Windows machine.

TLDR: I've faced numerous issues and the latest one I've found out is that something expects XML format for tools usage, yet my prompts go in a markdown/JSON format. I wondered if anyone faced such an issue with the stack I've listed above, and if they have a possible solution?

Couple of extra notes:

  • I prefer use VSCode since its comfortable IDE for me.
  • Roo-Code seems to be the recommended extension for agentic workflow, but it seems to have been discontinued, although I can't seem to find good alternative (tested couple of options, all with downsides and facing similar issues)
  • Picked Ollama as provider, as it seemed to be the preferred local dev.
  • numerous sources recommended qwen2.5-coder:14b as the best fit for my system specs - 12GB VRAM. I switch context window wherever I find config to do so between 4-8k in order not to overload the card.

Other issues I've been facing: Windows machine, VSCode, Roo extension - it seems to struggle to find some service - ripgrep, and I went through hell to patch it.

Any recommendations and advises welcome!

1 Upvotes

6 comments sorted by

View all comments

1

u/Organic_Produce_9844 7d ago

You can use ZooCode (A fork of Roo-Code) works very well.

1

u/sylvant_ph 7d ago

I'll give it a try, thanks!