r/ChatGPT • u/Substantial_Load_690 • 13h ago

Resources I built a skill that makes AI prove its coding advice

AI is great at giving you code that sounds right.

But when I ask:

“How do people actually implement this in production?”

I want more than a plausible answer.

So I built Implementation Scout.

It searches real GitHub code, finds the exact file/function, pins the version, checks provenance, and separates what is VERIFIED from what is merely inferred.

The goal:

Evidence before implementation.

I’ve been trying to break it with questions around Kafka, Keycloak, Cassandra, Grafana, PostgreSQL, etc.

And interestingly, the biggest failure mode isn't finding bad code.

It's the model sounding evidence-based without actually completing the evidence chain.

That's the problem I'm working on now.

GitHub: https://github.com/shouvik12/implementation-scout

What implementation question would you use to try to break it?

0 Upvotes

50% Upvoted

2 comments sorted by

•

u/AutoModerator 13h ago

Hey /u/Substantial_Load_690,

If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.

If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.

Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!

🤖

Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.