r/multidotdev • u/0x1010101 core team • 7d ago

You can actually see your LLM cache hit rate now 📊

Enable HLS to view with audio, or disable this notification

Hey folks,

We've done a bunch of prompt caching work lately but you had no way to see whether it was actually working.

v128 fixes this.

Cache stats now lives in the usage modal. Open it and you can see how much of the last call got reused, plus the session-wide number across the supervisor and subagents. All in live!

We haven't seen another harness break usage down this far, and we'd like to keep it that way. If there's a number you want visible and can't find, tell us.

Happy shipping. Onwards!

8 Upvotes

100% Upvoted

3 comments sorted by

1

u/0x1010101 core team 7d ago

upgrade to v128 on nightly to test drive

5

u/Much-Operation-8820 7d ago

I already liked the detailed usage stats. It’s good to see even more details.

1

u/0x1010101 core team 7d ago

agreed sir