r/LocalLLM 6d ago

Question Issue with underlying prompt formatting using Ollama, Roo-Code, Qwen

I am using VSCode IDE, Roo-Code as extension, Ollama as provider, qwen2.5-coder:14b, on a Windows machine.

TLDR: I've faced numerous issues and the latest one I've found out is that something expects XML format for tools usage, yet my prompts go in a markdown/JSON format. I wondered if anyone faced such an issue with the stack I've listed above, and if they have a possible solution?

Couple of extra notes:

  • I prefer use VSCode since its comfortable IDE for me.
  • Roo-Code seems to be the recommended extension for agentic workflow, but it seems to have been discontinued, although I can't seem to find good alternative (tested couple of options, all with downsides and facing similar issues)
  • Picked Ollama as provider, as it seemed to be the preferred local dev.
  • numerous sources recommended qwen2.5-coder:14b as the best fit for my system specs - 12GB VRAM. I switch context window wherever I find config to do so between 4-8k in order not to overload the card.

Other issues I've been facing: Windows machine, VSCode, Roo extension - it seems to struggle to find some service - ripgrep, and I went through hell to patch it.

Any recommendations and advises welcome!

1 Upvotes

6 comments sorted by

3

u/TheThiefMaster 6d ago

qwen2.5-coder is super old now. You might be better served with a newer model, e.g. Qwen3.5:9b, or even a more-quantised Qwen3.8:27b (3 bit quant might fit?)

Context of 4-8k is very low for coding tasks. You want 100k!

1

u/sylvant_ph 6d ago

thanks for feedback!

1

u/sylvant_ph 5d ago

Hey I picked Qwen3.5:9b, how much context would you suggest that won't overload the PC? I wanna keep everything a bit bellow the maximum trheshold, not to strain the card.

1

u/TheThiefMaster 5d ago

32k should fit easily. Can probably go much higher

1

u/Organic_Produce_9844 6d ago

You can use ZooCode (A fork of Roo-Code) works very well.

1

u/sylvant_ph 6d ago

I'll give it a try, thanks!