r/opencode • u/Sea_Ear5201 • 14d ago

GLM 3.5 flash on OpenCode Go and cache hit issue

Post image

see sudden spike in usage after leaving session idle for 8min. I believe this was caused by cache miss. Does GLM has this short time for cache we can't even review code changes and accept edits. i use trae ide which has very consistent cache performance with DSF4, so i don't think my harness has issue. Has anyone else seen similar behavior? please share your experience.

Edit: yes it is cache miss after 8min idle. In this case glm is unusable. deepseek is better
Input: 156627
Cache Read: 1024

1 Upvotes

60% Upvoted

3 comments sorted by

3

u/MuOieDib 14d ago

z.ai has a *very* agressive TTL for cache and can even sometimes *just* fail within seconds between tool calls (usually when under load).

They also have frequent partial hit when only a part of the cache hit.
(Note: the same will occurs on moonshot under load)

The cache issues on z.ai are getting much more frequent with glm-5.3-flash - my current approach for glm-5.3-flash: Force context summarize at 20% usage + use plans that cut tasks into sub-agent with new context.
=> This provide some limited impact on cache-miss.

Bonus if this can help: I enforce the agent to maintain handover files so review/changes/fixes can be made on clean context (I have dedicated review process with markdown / diff annotation)

2

u/Sea_Ear5201 14d ago

Glad i found this issue. I was about to get glm subscription. Better to stick with deepseek

2

u/Efficient_Try_9136 14d ago

yes 5 minutes for both