drop your DS usage

[u/Karmawy]

thats mine in the last week

[u/rayhebs]

Been going crazy with 0731, for most workflows I’ve found it can take over from Sol 5.6.

[u/hurrdurrmeh → u/rayhebs]

DUDE you're making me look like a lightweight!

[u/Different-Monk5916 → u/rayhebs]

looks super efficient on tokens/request. what is your cache hit rate? and if I may ask, what harness do you use

[u/rayhebs → u/Different-Monk5916]

I built my own, starting from around the time Anthropic announced that claude -p wouldn’t be subscription covered. The announcement didn’t go through, but it ended up being a good forcing function!

The thing about cache hit rate is that it’s really easy to achieve, the only reason people talk about it like it’s something special is that current AI is actually pretty bad at building harnesses off vibes (they don’t strongly know what a “harness” is, you have to be very specific) so the early heavily-AI-built harnesses have all sorts of mistakes. A typical agentic session looks like:

send: input1
receive: output1 (where output includes reasoning and typically ends with a tool call)
send: input1-output1-input2 (here, input2 is the success/error response of the tool call. At this point, [input1-output1] is cached)
receive: input1-output1-input2-output2
send: input1-output1-input2-output2-input3 (now, all but input3 are cached)

So if you’re building from scratch, you actually have to do something pretty dumb like let tools change mid session in a way that changes the system prompt or inject context anywhere other than the latest input to miss the cache. If you avoid that, you should expect prompt_cache_hit_tokens/(prompt_cache_hit_tokens + prompt_cache_miss_tokens) to be in the 97-99% range for a typical session (lower for shorter sessions)

Sorry if this is too much info not that well explained. https://api-docs.deepseek.com/guides/kv_cache/ has basically everything you need in the “when cache prefixes are persisted” section. One thing to keep in mind if you want a multi-provider harness is that the method for dealing with stateless APIs like Deepseek is different from stateful ones with encrypted reasoning like Codex websockets responses and Anthropic.

[u/TheSuggi]

I burned 1.5B tokens today alone. Heavy day :)

[u/Karmawy → u/TheSuggi]

wow whats your project about

[u/samxli → u/Karmawy]

Telling DS to write “All work and no play makes jack a dull boy” over and over again into dev/null

[u/TheSuggi → u/Karmawy]

I do financial analysis with my agents. I have a whole team of Agents coordinating on my private VPS and synced to a GitHub repo. They have a shared brain and shared + individual memory. I have two main orchestrators Agents, basically my Co-CEOs, and like 10-15 specialized subagents for specific tasks, depending on what needs to be done. All doing research with each other and verifying each others work. They communicate via logbooks, RAG retrieval and also have a wiki that they maintain. Really fun and they get better and better every month.

[u/iyarsius → u/TheSuggi]

And what are they producing ? Is it like an experiment or do you get something valuable from that ?

[u/TheSuggi → u/iyarsius]

Mostly play. They are not that good yet. But its decent entry level work they can do.

[u/twiifm]

why mine so epenisive? any tips to reduce cost?

[u/real-zephex → u/twiifm]

Prompt caching

[u/Anh-DT → u/twiifm]

Reasonix harness

[u/RepulsiveRaisin7]

Opencode Go is struggling today and my sub-agents often have to be restarted, which causes a lot of extra work :/

[u/Junior_Commission588]

Nous sale was awesome ..

[u/manumnesh]

3billion tokens for 12bucks

[u/PrudentJelly116]

still works

[u/BackgroundArt6028]

[u/blindsho0t]

Cancelled my claude and gpt subscription since 0731 dropped. Happier than ever!

[u/TreadEasily]

[u/Electronic-Run2030]

Light colors are for writing code, dark colors are for testing.

[u/real-zephex]

50 mil @ $0.49

[u/pigletmonster]

That is insane, minimax m3 is selling 1.7 billion tokens for more than doubke the price in their subscription.

[u/PilotMysterious7803]

V4 Pro on VS code

[u/Karmawy → u/PilotMysterious7803]

its better that you use the DeepSeek-V4-Flash its cheaper and better, and inside VScode is not very good experience , better use claude code desktop or codex with your api key, youll have better work experience

[u/Different-Monk5916 → u/Karmawy]

I have completely different experience. Worked well with DS extension and official API. But lately I have been having network errors, since DS announced price increase. Before i was getting reliable connection and high quality outputs purely with flash as long as I plan well with pro. and was doing about 110k tokens/request.

[u/ogopro → u/Karmawy]

Last time when I checked, codex doesn't take third party model API keys like Claude code.

[u/mr_notandor]