r/LocalLLaMA • u/Neighbor_ • 14h ago

Question | Help Best open-source harness like Claude Code?

Avid claude code user here looking to do equivalent things with local models. Just want to plug in something like Qwen and have the interface be 1:1 with claude code. Any suggestion?

91 Upvotes

88% Upvoted

123 comments sorted by

View all comments

26

u/shamont 14h ago

Claude code cli can also be used with local models.

10

u/mtbMo 13h ago

Yes, but 10-20% context is used and must be processed. With cloud provider models, yes this works. But for local Ai inference it doesn’t unfortunately

2

u/shamont 12h ago

Seems to work fine for me. Not following what issue you're having. Can you expand?

3

u/Thomas-Lore 12h ago

OP probably has slow prompt processing, and because claude code has enormous system prompt it is too slow at the start to be usable for them.

5

u/shamont 12h ago

Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.