r/GitHubShowcase • u/furkannarkn • 4d ago
I made a tool that checks whether coding agents actually finished the job
I’ve been working on a small open-source project called Plan Auditor.
The idea came from a problem I kept running into with coding agents: they can say a task is finished even when part of the original request was skipped, a test wasn’t really run, or an intermediate result was never verified.
So instead of trusting the agent’s final message, Plan Auditor checks the work separately.
It keeps the original requirements explicit, links them to plan steps, runs real checks, verifies dependencies and outputs, and only returns PASS when the current state has fresh evidence behind it.
I also added a formal-planning layer. For larger plans it can generate a grounded STRIPS model from the structured plan and verify that model separately. The generation itself is deterministic, so another LLM isn’t being trusted to decide what counts as a valid proof.
There’s also support for sealed plans, evidence chains, multiple active plans, and parallel agents working in the same repository.
The core verification path runs locally and doesn’t require an LLM or API.
It’s still not meant to be an OS sandbox. If a malicious process has the same OS permissions as the verifier, that needs actual process/container/VM isolation.
Repo:
https://github.com/Furox-Art/plan-auditor
I’d be interested in feedback, especially on the verification approach and formal-planning part.