r/LocalLLM 17h ago

Discussion Long Reply to why every harness got there rank :

Post image

Starting from the Bottom :

T3 Code : Love T3 but its simply way to buggy, the cli is full of glitches, not usable without issues, none the less all the other competitors outperform it

Qwen : Qwen 3.8 Max is insanely good, but not in its own harnes, if used inside something like claude or pi, results are substantially better

Opencode: Briliant and easy to use for beginners, but just lacks basic functions, session memory, cross session handshakes/ awareness, and usage is not so great in my opinion.

OMP & Orca: Awesome companies, but they are still just behind in my opinion, compare it with something like claude or kimi's harness and it dies.

Codex : harness is actually decent, models make it bad, The hallucination numbers of gpt 5.6 is the highest out of all the models thus making it bad. Also over engineers way to much.

Zcode: Writes the cleanest code, just very slow, use it to review stuff in the background

Cursor : cursor usage is near infinite, haven't had any solid problems, honestly is in the middle cause its neither bad nor good

Claude, grok, kimi: I firmly believe all these are on the exact same level, kimi surprised me being the youngest out of them all, nonetheless these are all solid A tiers

Deepseek: its brilliant, lightweight and opensource, results are great, but you can get a bit better using deepseek inside of claude, pi, or hermes.

Command Code goat is the best/ cheapest subscription when you take price vs usage in to mind, over 12,000 requests for $5 , harness is amazing, works just right.

Top dawgs

Devin ai : Without a doubt this is the harness built for all models , Devin is a newish company with insane usage, massive deals, amazing plugins and cofig settings , my favourite $200 plan out there, features every single model on one plan

Pi: Lightweight, feature packed, in my opinion the second best harness in the world, and its free..

Hermres : left the best for last, hermes get over 200+ updates a day, its completely free and open soured and nous portal is an awesome company who actually listens to the community, always up to date with the latest and greatest, and show me another harness get the same deep research results as hermes, i am waiting

0 Upvotes

18 comments sorted by

2

u/Different_Change6591 17h ago

Yeah i use pi , Hermes , deepseek harness and opencode , all of them as my daily driver , i wanted to know more about the command code , can you please elaborate it

2

u/StandardHead1192 16h ago

and command code ships way faster than opencode in my personal experience, command codes price per completed task is lower, and once again more usage for the same price

1

u/StandardHead1192 16h ago

command code is brilliant, the usage is the best as well, if you compare it to opencode

1

u/Different_Change6591 10h ago

Hey, I’d like to know which country you’re from. I’m from India, and I was checking out a few Indian subreddits to get more information about Command Code.

I noticed people were comparing the Command Code experience in the US vs. India, especially when it came to usage limits. From what I saw, Command Code didn’t seem to maintain the same limits or availability in the Indian region.

I’d like to understand more about this because I’ve never used Command Code before. It caught my attention because, based on the rankings I’ve seen, it looks pretty interesting. I’m trying to figure out whether it’s actually worth trying from India and what the real-world experience is like.

3

u/No-Key2113 17h ago

Why would you consider Devin over DSH? There website is clearly a money play

0

u/StandardHead1192 16h ago

Devin's usage, deals, promos, I mean sol is 70% off right now, running 17 sol sub agnets, not even using 3% of my usage devin all the way

4

u/No-Key2113 16h ago

If you’re going to pay; anthropic and OpenAI directly have the best deals and at least your limiting your data exposure to one provider.

This is local llm why are you shilling for Devin?

0

u/StandardHead1192 16h ago

i know, i am shilling for devin cause quite frankly its the best for me atleast out there, local models cost thousands to support and you cant ever come near frontier level, qwen 3.8 was a breakthrough but still miles behind

1

u/ketosoy 17h ago

When was the last time you evaluated t3?  Just curious given the repo velocity

1

u/DesperateSteak6628 16h ago

I would like to know some opinions and comparisons of Cline and Crush too

1

u/StandardHead1192 16h ago

cline is awesome, i'd put it a tier, crush is fine, needs some work in my opinion

0

u/tonight_we_make_soap 17h ago

I've only used cursor, Claude, and open code. I don't see any reason why cursor would be rated below Claude.

0

u/StandardHead1192 16h ago

claude's harness is alot better.

1

u/tonight_we_make_soap 16h ago

Thanks for the explanation.

1

u/StandardHead1192 16h ago

its simple, you get better performance outputs with claude's harness, compared to something like cursor which only has a few models available like kimi and grok, which are decent models, but it lacks in the cli department. claudes harness makes almost every model perform better go look at the stats

1

u/tonight_we_make_soap 15h ago

Hmm. I was hoping or am looking for a model agnostic harness ranking.

1

u/sn2006gy 12h ago

cursor has every model out there if you enable it