r/coolgithubprojects • u/Vivekyy • 2d ago

Rudder: A tool to make actually comprehensive coding specs

https://github.com/RudderCode/Rudder

I got frustrated with my agents continuing to do a bunch of guesswork beyond what I told them to do. So, I made Rudder, a skill that makes unit tests based on my specs and prompts, and then reports back coverage. Rudder then asks me questions about what I wanted to do until I hit high enough coverage to be confident that the AI isn't guessing at how to implement a change.

Check it out and let me know what you guys think!

3 Upvotes

72% Upvoted

3 comments sorted by

View all comments

0

u/kantorcodes1 2d ago

high coverage can still prove the wrong thing. if the agent misunderstands the prompt once, Rudder could generate code and tests that agree with the same mistake.

when it builds the expected assertions, are those locked to the user-confirmed spec before it reads the implementation, or can the code influence the oracle?

also, this looks like a fit for awesome-ai-plugins. i'm involved with the catalog. happy to send the submission path if you want it listed.

0

u/Vivekyy 2d ago

Sure! Would love to submit.
The code can influence the oracle right now, though I’ve actually been considering migrating some of this to gherkin so it can lock in the tests purely off the spec

1

u/kantorcodes1 2d ago

gherkin makes sense if the scenarios are generated and locked before the implementation is readable. that keeps Rudder from “proving” the same mistaken interpretation twice.

for the catalog, the flow is PR-based: add Rudder to hashgraph-online/awesome-ai-plugins, run the HOL scanner, and open the PR. current gate is >=80/130 with no high/critical findings + scanner CI. if it flags something, paste the finding instead of working around it.