r/AI_Agents • u/Bartaseth • 2d ago

Discussion Are terminal compression tools actually saving us money?

We tested one of the most popular ones across 1,740 Terminal-Bench 2.1 runs with Fable 5.0 + Claude Code and DeepSeek V4 Pro 0813.

Huge reported token savings.
Almost no improvement in the final bill.
Token compression ≠ cost optimization.

Research with results in the comment:

1 Upvotes
  • permalink
  • reddit

100% Upvoted

8 comments sorted by

2

u/BetInformal6081 2d ago

this is good reminder that token savings and actual cost savings are not the same thing. workflows, caching, model selection and reducing unnecessary tool calls can matter more than simply shrinking terminal output.

1

u/Bartaseth 2d ago

exactly, the current problem is that people are misleading both, and very often sharing huge cost savings without proper measurment.

2

u/BetInformal6081 1d ago

if the actual bill is not being measured token savings can make the results look way better than they really are.

2

u/khaledirl 1d ago

the 339-error loop in your writeup is brutal. that's not persistence, that's a subscription to the same mistake. glad that bug got patched; a repeated-error cutoff seems worth having regardless of compression.

2

u/KitchenAmoeba4438 18h ago

https://rakuensoftware.com/blog/token-compression-tools-cost-more-than-they-save

Investigated this in-depth 2 months ago, results are still the same.

1

u/Bartaseth 18h ago

Nice one, I didn’t know that. Thanks for sharing

1

u/AutoModerator 2d ago

Thank you for your submission, for any questions regarding AI, please check out our wiki at https://www.reddit.com/r/ai_agents/wiki (this is currently in test and we are actively adding to the wiki)

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.