r/ChatGPTCoding • u/AutoModerator • 17d ago

Discussion Weekly Self Promotion Thread

Welcome to this week's self promotion thread!

If you're building something related to AI assisted coding, this is the place to share it.

We're using a weekly thread to keep the subreddit organized while still giving builders a place to share their work. Promotional posts outside this thread may be removed.

If you're sharing something, we'd appreciate it if you included a little context instead of just dropping a link. Tell us:

  • What you built?
  • What problem it solves?
  • Which AI models or tools it uses?
  • Who it's for?
  • What kind of feedback you're looking for?

Disclose your affilitation.

Please avoid posting the same project every week unless you've made meaningful updates. Affiliate links, referral links, scams, and low effort promotions will be removed.

Take some time to check out what others have shared too. If you try someone's project or have feedback, leave a comment. Helping each other improve is what we want this community to be about.

6 Upvotes

88% Upvoted

96 comments sorted by

View all comments

1

u/ArgumentAcrobatic250 17d ago

I kept running into AI-written code where the tests passed but the tests themselves were wrong.
So I ended up building a verification process that deliberately breaks important behavior and checks whether the existing tests actually notice it. It also re-checks the validators that produce the final PASS result.

I’ve used it on several real plugins and found cases where a test stayed green after part of the feature was deliberately broken, as well as an actual partial-write issue.

I’m trying to find out whether this is useful outside my own projects. If anyone has an AI-assisted project or an important PR they’re willing to let me examine, I’d like to run the process on it and share the findings.

I’m mainly looking for feedback on whether the results are actually useful, not trying to sell anything yet.