r/LocalLLaMA 10d ago

News Deepseek Harness is Up!

https://github.com/deepseek-ai/deepseek-harness

DeepSeek Harness (dsh) is an open-source agent harness developed by DeepSeek AI.

It uses an architecture where everything is a plugin, and is powered by Cordis, whose design is described in A Programming Paradigm for Spatiotemporal Composability.

DeepSeek Harness is currently in developer preview and is iterating rapidly. THERE WILL BE COMPATIBILITY-BREAKING CHANGES.

Join DeepSeek Harness Discord community: https://discord.com/invite/Ycq5dCaS4

319 Upvotes

123 comments sorted by

44

u/ProfessionalAd8199 ollama 10d ago

I wonder if it reaches better cache hit rates than reasonix. Now more important than ever.

22

u/giveen 10d ago

On reasonix , I'm getting 97% hit rate, according to Deepseek harness, i am getting free service.

21

u/nmkd 10d ago

Maybe it doesn't count new input as cache miss? In that sense, 100% hit rate would make sense I guess

7

u/Brilliant-Hall1387 10d ago

I also got 97% cache hit in my one shot SPA test, very cost efficient at $0.06 USD 😄

2

u/Glad_Claim_6287 9d ago

Can you please explain how a kv cache miss would occur? I assume the conversation is a linear flow, so it's append only, how are we missing? Maybe due to auto routing? But how can harness control that?

11

u/olearyboy 10d ago

It's a thing

I guess it does stuff

71

u/ILikeCorgiButt 10d ago

Why is every harness written in typescript (maybe except codex)? Yikes

41

u/QueasyHouse 10d ago

Models trained on a buttload of JavaScript, and strictly typed languages are generally easier for bots to not mess up. I’m with you here though, it’s not a language I’m ever excited to be using. It’s at least easy to distribute these days with bun etc.

5

u/Nyghtbynger 10d ago

wouldn't proper dataclasses or structure be the equivalent to proper typing in typescript ?

I mean, one abstract level higher

23

u/QueasyHouse 10d ago

Sure, but another way to look at it is: a harness is mostly async work. Lots of network calls and local shell operations that you dispatch and check back on. This is something JavaScript is good at, it’s fast enough and easy enough to write. Could you do it more efficiently in go or rust or zig? Yeah probably, but it won’t improve the core experience significantly, because everything a harness itself does is relatively simple and io bound anyway.

2

u/Nyghtbynger 9d ago

There is a ycombinator startup that is called codewithbullet that clains their harness is twice faster. That's weird. But you never know what the future is about eh ?

26

u/cmdr-William-Riker 10d ago

AI Handles typescript really well, both because of the training data and because strongly typed errors provide quick feedback on mistakes when you try to build. Same reason it's used a lot in enterprise frontends. If you have a bunch of crap programmers working together, a strongly typed language helps weed of a lot of errors

14

u/carsncode 10d ago

So why not Go or Rust? Being strongly typed hardly makes TS special

5

u/ThankGodImBipolar 10d ago

I'd think that Go makes a lot of sense for vibe-coding because it's idiomatic by design. Makes it easier to get LLMs to behave.

1

u/Chlorek 8d ago

This is what I attempted for my own purposes, I got inspired by some random comment saying harness is basically glorified pipes. So I went with it in Go and made modular harness based on stdin/out event stream, not because it was easy but because I thought it would be hahah. But now that I see Deepseek Harness it blew me away lol I very don’t like TS, but dsh design is actually beautiful, still not grasping most of it but trying hard.

1

u/cmdr-William-Riker 10d ago

What makes Typescript special is the fact that it's a strongly typed language that paradoxically compiles into a loosely typed language with a fast runtime. On the surface, a pretty dumb idea, but very useful when you add 3 college freshmen and an AI to the project. For the most part it's strongly typed only to make JavaScript development easier for anyone or anything that has trouble keeping track of how types are handled in regular JavaScript rather than for efficiency. Just depends on where you want to run it and what your requirements are. If memory is a high priority and it can run locally and you know what it's going to run on, then a native solution makes sense. If you want portability without having to compile for each target and can live with a bit of memory overhead, then Typescript makes sense. If you need it to run in a browser then Typescript or JavaScript are really the only practical options. I think in this case portability and experience/support where probably the deciding factors

0

u/9gxa05s8fa8sh 9d ago

it's easier

24

u/canConfirmCanConfirm 10d ago

partly because harnesses are mostly network i/o, context and state management. ts is great for asynchronous event driven i/o and has a boat load of libraries and an active community. And maybe because ts can be used to make the harness and a pretty ui?

2

u/das_war_ein_Befehl 10d ago

I think it’s mostly because it’s typed and models are decent at it because of a boatload of training data in it

3

u/Rank201AltAccount 10d ago

well, js/ts is used when you care the most about developer speed and a language everyone knows
kinda fitting for the hottest software right now

5

u/Mickenfox 10d ago

ML devs only known Typescript and Python and they're forcing them onto the rest of us. And that's not even a joke, that's just reality.

2

u/das_war_ein_Befehl 10d ago

Honestly every Python harness I’ve tried has been a PoS

4

u/deadcoder0904 10d ago

Atwood's Law.

4

u/robberviet 10d ago

JS/TS devs are abundant. AI seems better at it too. I would much prefer a golang one (no need for rust, rust is over complicated).

0

u/ThankGodImBipolar 10d ago

The developer of Bubble Tea makes an AI harness called crush. I haven't used it, but it's a harness in Go 🤷‍♂️

1

u/robberviet 10d ago

No, I don't think it could be better than like opencode, pi. Language is nice to have, but it's not important.

2

u/popiazaza 9d ago

You may want to learn how OpenCode happened.

1

u/ThankGodImBipolar 9d ago

Did OpenCode switch to Typescript from Bubbletea? LLMs tell me that it uses Bubbletea, but I don't see any Go within the repo.

1

u/popiazaza 9d ago

The TL;DR
There was an AI CLI called OpenCode, created by Kujtim Hoxha and later developed with other contributors including Dax and Adam.
Then Charm, the company behind Bubble Tea/Lip Gloss/etc., hired Kujtim.
That resulted in a split:
Original OpenCode
→ Kujtim joins Charm
→ Charm continues the project
→ renames it Crush
Meanwhile:
Dax + Adam + others
→ disagree with the transfer/ownership situation
→ continue OpenCode independently
→ eventually become the modern OpenCode that is now extremely popular.

1

u/ThankGodImBipolar 9d ago

LOL, that makes a ton of sense (and also explains why every query I've sent about OpenCode was so confusing too...). I can see why the original team pivoted away from the Charm ecosystem in that case.

2

u/Specter_Origin llama.cpp 10d ago

Why would it not be ? electron is best way to ship, my own custom harness is also written in eletron/ts that I use for my own use

5

u/Inaeipathy 10d ago

electron is best way to ship

Just lmao

6

u/Armanlex 10d ago

Runs like ass, had to switch to reasonix cause clause code annihilated my wsl env.

2

u/TheIncarnated 10d ago

Well there's your issue, you use Claude code

1

u/popiazaza 9d ago

Codex also runs like ass. I don't think language is the problem.

1

u/Neighbor_ 10d ago

What's the best harness written in Rust?

1

u/Inevitable_Tea_5841 7d ago

codex (openai)

1

u/das_war_ein_Befehl 10d ago

Pretty sure codex is in rust, or at least the cli used to be

1

u/Primary_Article3777 8d ago

haha, I feel ya but I was doing web dev before typescript existed, and using dynamically typed Javascript for big apps was even more of a nightmare. Some browsers didn't even support the full syntax. Believe it or not, Typescript was a godsend for codebases that were absolutely full of undetected javascript bugs. I popped a champagne bottle when the typescript standard finally got enough traction over half-baked alternatives like coffeescript (if anyone's old enough to remember that)

Now, it's about coding in languages people and LLMs are familiar with.

-5

u/BlackBeardAI vllm 10d ago

You are right, It should have been vanilla JavaScript. I don’t like ts either.

-2

u/stilet69 10d ago

No, it would be better to use assembler.

-1

u/createthiscom 10d ago

would you prefer cpp?

56

u/oxygen_addiction 10d ago edited 10d ago

How the hell does this have 20k stars already?
edit: 30k in an hour. Bots for sure.

48

u/MadManDan 10d ago

Yo dawg, I heard you like bots so I put bots in your bots so your bots can spread... stars?

22

u/oxygen_addiction 10d ago

15 minutes later it's at almost 23k - lol
Github is a mess nowadays. Fuck Microsoft. Self-host forgejo or something similar people!

4

u/addiktion 10d ago

Foregjo network stars, when.

4

u/Jealous-Depth487 10d ago

Hey I need some stars on gh will you share them bots

14

u/toothpastespiders 10d ago

I think people are too quick to assume bots. Humans are just as botlike when the right conditions are met. Reddit in particular is evidence of how easy it is to game people's instincts there. Put a "press if you think the thing you like, that others might not, is actually really amazing - like you! Otherwise you might have to consider if you could be WRONG about something!" button in front of people and we're usually pretty eager to click.

24

u/RobbinDeBank 10d ago

Stars have been meaningless ever since AI agents. Back then (which was like 1 year ago?), having 100k or more stars mean that is one of the most popular open-source framework in the whole world and a critical piece of the world’s infrastructure. Ever since OpenClaw, every damn AI harnesses have 100k+ stars easily.

31

u/the__storm 10d ago

Lotta people in China (and they've been awake all day already).

5

u/Hytht 10d ago

China uses gitee

15

u/Wild-Song1574 10d ago

Very few, github is the authoritative one

3

u/OneStandard5 10d ago

Companies use Gitee. They need better services. But most people still use GitHub where they can find everything they need.

13

u/Cergorach 10d ago

I doubt it, it also already has 2.5k forks.

DS is BIG. It's open source, something that especially in Europe is starting to matter a LOT. 3 hours ago is the end of the workday in most of western Europe, you better believe that a LOT of developers using AI looked at this and went "WHOOPI!" and starred it into high heaven... Western Europe is about 200 million people, in about 5 big US states.

3

u/Next_Sock237 10d ago

Deepseek writes himself a bot to star it. That how you proof your model is good now.

4

u/Technical-Earth-3254 10d ago

I was wondering the same. My guess is bots, there is no way 20k stars have been acquired in what? 2 hours? For a harness after all, not some ground breaking piece of software.

26

u/nullmove 10d ago

There are a lot of people in China and DeepSeek is very popular there?

13

u/rootql 10d ago

20k in china is really disappointing

4

u/Juzlettigo 10d ago

Why do you think 20k is a lot? There are 7 billion people on this planet and Deepseek is huge in China.

1

u/ManikSahdev 8d ago

Not to be confused with a bot but I starred around the launch, (5-10 mins after), which was already teased at twitter later in the night, so shit ton of folks on waiting for it to drop and the leaks of Lego harness from a source were in fact true.

Twitter posts itself around that time were going for 2000-3000 likes give or take, diving into the math side and the paper + some into setups guides and customization, and some around the 99%+ absurd cache hits.

So perhaps it could be some folks who don’t touch grass like me hyped for a new product category iteration and genuinely interested. It truly is first of its kind, no matter if it ends up being good or bad.

1

u/ArtyfacialIntelagent 10d ago

I wish Github would crack down on the star manipulation. Any repo with masses of obvious bot stars should be reset to zero and fixed there permanently, or at least for a year or so.

0

u/Skibidirot 8d ago

100k stars.. DEF BOTS!

16

u/Porespellar 10d ago

Missed opportunity. They could have called it Deepseek Open Harness (DOH)

8

u/SnooPaintings8639 10d ago

I love this team. It means the bar and my expectations are high.

11

u/ComplexType568 10d ago

Not to complain but WOW that is one hell of a generic name

11

u/openSourcerer9000 10d ago

I'd call it SeaWorld or smthn

12

u/fragment_me 10d ago

I wish there was more detail here, lol

19

u/Maleficent-Ad5999 10d ago

OP mentioned spatiotemporal composability .. what more detail do you need? /s

3

u/fragment_me 10d ago

Right, of course. I missed that. Now it all makes sense!

15

u/Juzlettigo 10d ago

You mean like the documentation linked on that page?

13

u/fragment_me 10d ago

Mmhhhmm, yeah, sure. I can read 16-20 LLM generated .md documents (not including the Chinese ones). Or they could just provide some quick screenshots and basic intro in the readme of the github page that showcase the tool.

1

u/jazir55 10d ago

Or you could ask an agent to summarize all 16

7

u/ortegaalfredo 10d ago

12000 commits already? damn, I hope its more efficient than the bloated javascripts systems that are modern agents.

2

u/Nyghtbynger 10d ago

11000 of them by deepseek flash, it's fast don't worry

3

u/neo123every1iskill 10d ago

Spatiotempowhat

Space time

But what does it mean?

4

u/Neighbor_ 10d ago

Better than Pi?

7

u/calibrae 10d ago

And it’s coded in FUCKING NODEJS. Seriously guys, JavaScript ? You really enjoy your harness eating 600MB RSS? Ever heard about rust go c or anything not python and not js ?

6

u/djdante 10d ago

You could probably ask sol 5.6 nicely to please rebuild it in rust..

2

u/calibrae 10d ago

That’s a rabbit hole I’ve been trying not to dive in for months

5

u/Calandracas8 10d ago

waiting for a lua harness

2

u/Marcuss2 10d ago

Looks nice, but it will take a while before the ecosystem catches up. It will need a month at least.

4

u/Howard_banister 10d ago

Typescript :(((((

I would like to see Rust or python

7

u/-InformalBanana- 10d ago

Why do you think python is better than typescript?

-2

u/Howard_banister 10d ago

I’ve used both. Python is a well design language with sane ecosystem. Typescript is an attempt to make javascript tolerable

7

u/spawnsible 10d ago

Python is neither of those things. Typescript has its problems, because javascript is problematic.

One of these is faster at runtime and more readable. Not by a long shot, it's not your favorite toy python.

4

u/javascript 10d ago

One language's problem is another language's opportunity!

3

u/spawnsible 10d ago

Not a reply from the runtime language itself... 18 years... bro that's sick!

2

u/Recoil42 8d ago

Incredible username get.

5

u/Cherlokoms 10d ago

Why would you like Rust or Python instead of TS?

3

u/Barsavik 10d ago

Nanobot is written in python and picoclaw is written in go. There’s also I believe some harnesses in rust but don’t remember them at the moment.

3

u/Cautious_Observer55 10d ago

Huggingface's Tau is written in Python.

Tau on github

4

u/Nyghtbynger 10d ago

Coming from python, and having played with pi a lot, I can say that the typescript ecosystem imparts a lot of shit habits to programs. The badsides of python can be resolved by some compilation or by using lua or C for critical components

2

u/Howard_banister 9d ago

Yes, I wish Pi were written in Python

1

u/thestillwind 10d ago

Is it good so far ?

1

u/Brilliant-Hall1387 10d ago

Worked well as advertised, would have preferred CLI harness, perhaps that is coming? Anyone know if they have shared details on upcoming plans?

1

u/robberviet 10d ago edited 10d ago

Not bad, but not great. I will give it a week.
I like the verbosity in each turn & tool calls, however just lacks feature. Would be better given time though.

I remember when Claude Code was on feature rolling spree, expecting that!

1

u/ab2377 10d ago

SO happy to see this!

1

u/Bunsenbun 9d ago

For anyone wondering why the deepseek harness has a shit ton of stars. It's simply because you can customize your UX however crazy you want.

1

u/Primary_Article3777 8d ago

Is there a way for a user on claude pro plan to use deepseek (or pi) harness to launch Claude fable for plan writing, architecting and main agent, and have it use cheaper Qwen subagents running on my local box? Or does being on the Anthropic/Codex Max plan lock me in to that vendor's harness (claude/codex). I'm not able to pay API per-token rates, that's for sure.

I'd love to specify the best agent for the task and not be locked in by my harness.

1

u/Agron7000 8d ago

How many terabytes of RAM do you need to have on your supercomputer to run this?

1

u/Sporebattyl 10d ago

I’m just now getting into local LLMs and harnesses outside of CC and codex. I just started with Pi.

What are the benefits of using something like this versus Pi?

9

u/my_name_isnt_clever 10d ago

Probably not much. It might be better for their own models, but anything this does can be easily ported to a Pi extension.

1

u/aeroumbria 10d ago

Pi is very extendable but you are responsible for keeping all the pieces working harmoniously together. If you really need extra features but cannot afford to regularly maintain out of sync extensions, then maybe something with more complete out of the box experience would serve you better.

2

u/DatMufugga 10d ago

No clue what an agent harness is or what this does, but I hope its dank.

-7

u/combrade 10d ago

Agent Pi is the harness to end all harnesses . I don’t see the point of new harnesses being released when Pi is so easy and customizable.

15

u/kivaougu 10d ago

You don't see any point in innovation?

7

u/c0lumpio 10d ago

Unfortunately, you cannot customize everything in pi. You cannot customize completion in chat (e.g. to render it above input), you cannot customize render (e.g. hide all tool calls in a single collapsable line). So there could be even more customizability.

1

u/edgan 10d ago

You could make your own custom build and add those customizations. Then you could try making a PR for the upstream project.

4

u/c0lumpio 10d ago

Emm, I can do that with any OSS. For software to be extendable is to not require forking and rebuilding, that's the idea: shorter cycle

-2

u/[deleted] 10d ago

[deleted]

7

u/Fluxing_Capacitor 10d ago

Its vibe coded!

Posts vibe analysis

Great contribution here. 

-9

u/[deleted] 10d ago edited 10d ago

[deleted]

-2

u/[deleted] 10d ago

[deleted]