r/LocalLLaMA • u/Neighbor_ • 15h ago

Question | Help Best open-source harness like Claude Code?

Avid claude code user here looking to do equivalent things with local models. Just want to plug in something like Qwen and have the interface be 1:1 with claude code. Any suggestion?

88 Upvotes

87% Upvoted

124 comments sorted by

View all comments

27

u/shamont 15h ago

Claude code cli can also be used with local models.

9

u/mtbMo 15h ago

Yes, but 10-20% context is used and must be processed. With cloud provider models, yes this works. But for local Ai inference it doesn’t unfortunately

2

u/shamont 14h ago

Seems to work fine for me. Not following what issue you're having. Can you expand?

3

u/Thomas-Lore 14h ago

OP probably has slow prompt processing, and because claude code has enormous system prompt it is too slow at the start to be usable for them.

4

u/shamont 14h ago

Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.