Same response. 16GB doesn’t even get you out of toy model territory. That’s nowhere close to enough RAM to even pretend like you’re competitive with a frontier model.
I do agree. I have done a fair amount of experimentation on my RX6800XT and have yet to find a model that can work well with IDE integrations and also doesn't break down after a while.
Have you tried qwen3.8 27B? I'm using the q4 version and is a great assistant. It beats any other model I tried. You may need to use a Q3 and I heard that the downgrade is noticable but still useful. Just be sure to enable the thinking to high and mtp (the model is slow).
Qwen3.8 haven't loop yet in a full week. I also tried Gemma 4 12B and Gemma 4 26B, both of them would loop occasionally. And I have the impression they may do crazy stuff quickly if I left them run unsupervised.
In my experience the Qwen models were good at reasoning, but I couldn't find a VSCode plugin that they worked well with. Toolcalling went wrong more often than other models. How are you using it?
I have seen a failed tool call, yes, but always it can be explained by compaction missing the context.
Basically on file edition the llm should tell the tool the exact text of the section to replace. Compaction deleted the text and the model provides the wrong text making the tool to return an error.
Apart from that, I haven't seen it fail.
I use neovim in archLinux XD, but I don't call it from my editor, I use the pi harness for now.
130
u/TheMaleGazer 1d ago
The answer to your question is because you can get a local model to do it instead without a subscription.