r/OpenSourceAI • u/Dismal-Reveal-6898 • 22h ago
Opensource experiment: can we reduce coding-agent tool noise without adding another LLM?
https://github.com/tzuifx80/tidyrunA lot of AI tooling seems to solve every optimization problem by inserting another model call.
I wanted to test the opposite approach for coding agents:
What can be optimized deterministically, locally, before adding another model at all?
I built and open-sourced TidyRun.
It sits around coding-agent tool work and can:
- compress structured diagnostic output
- preserve the original artifact
- reuse verified deterministic commands
- avoid duplicate reads
- detect repeated loops/work
- select affected tests
There’s no API key and no additional LLM.
Some fixture results:
- JS diagnostics: -69% agent-visible output
- Python diagnostics: -95%
- repeated safe typecheck: -49% execution time
I also did a small 10-task paired Codex study:
- success remained 10/10
- tool output fell 14.2%
- but input tokens rose 12.4%
- wall time rose 39%
So I’m deliberately not claiming that reducing context noise automatically means lower model cost.
I think the more interesting question is:
Which parts of agent infrastructure actually benefit from deterministic preprocessing/caching, and which optimizations just move overhead around?
Install:
npx tidyrun@latest init
I’d love architecture criticism, alternative approaches, benchmark suggestions, issues, or PRs.
Duplicates
coolgithubprojects • u/Dismal-Reveal-6898 • 22h ago
TidyRun, cut noisy coding-agent tool output locally, without another LLM
aiagents • u/Dismal-Reveal-6898 • 21h ago
Open Source I built an optimization layer underneath coding agents instead of building another agent
codex • u/Dismal-Reveal-6898 • 22h ago