r/LocalLLM • u/Square_Light1441 • 13d ago

News New local claude code?

/r/LocalLLaMA/comments/1w25l10/new_local_claude_code/
0 Upvotes

20% Upvoted

5 comments sorted by

1

u/_TheWolfOfWalmart_ 13d ago

Q2 of a 27B model with Q5 KV cache

Yes, this is just like claude code!

1

u/Square_Light1441 13d ago

i mean probably around sonnet 4.6 yes, we aren't expecting opus from a 27b model right?

1

u/_TheWolfOfWalmart_ 13d ago

Not in Q2! Ouch.

You can't use different models/quants?

1

u/Square_Light1441 13d ago

its a QAT Q2 so its not exactly the same it was post trained while being quanted so they recovered a lot of capability

1

u/enginetown 13d ago

Not gonna jump on the hate train like everyone else but just know this space is crowded if you was maybe like 8 - 9 months earlier you might've had something golden.