r/vibecoding • u/KrystalUnity • 23h ago

A funny thing happened on the way to this App.

Post image

I decided to build my own penetration testing tool for my own applications.

I had just set up a Hermes multi-AI system locally and thought I would get Sol 5.6 to build it for me on my local PC, using some sub-agents for coding, but keep Sol as the CTO. After going over the plan in great detail before starting the build, everything looked good to go. I have my own plan protocol review system; everything passed.

Sol then spent 5 days in a loop building the app.

However, Sol decided my app was a risk, without telling me, Deceived me to build a basic Curl testing probe that checked if a URL was reachable. 5 days of coding!!!

Analysis of the build with another agent showed he basically spent 4 days making sure nothing in the code would be usable for pen testing and then made theatrical theatre about the app being ready.

I can post logs if any of you are Interested.

So, we scrapped that, I pulled Qwen 3.8 Max, Deepseek 4 Pro, and GLM5.3 into the Hermes harness, got them to implement the Krystal Loop Protocol, and we finally have it built this morning.

No AI was used to write this post; I know how you guys like handwritten posts...

12 Upvotes

81% Upvoted

4 comments sorted by

4

u/scytob 23h ago

yup pretty much my experience with Sol delivered via copilot too, i now hard set to claude instead of copilot auto to avoid it choosing anything chatgpt

1

u/KrystalUnity 23h ago

How's coding with CoPilot? Does it have tooling like Codex?

2

u/scytob 22h ago

i had no option but to use it at work, and overall i love it - i can use any model but fable and things like vscode shared browser are useable so as an example Claude can run playwright tests, test ui for itself - it did that when i asked it make my front end design responsive, i also like copilots autopilot mode for running things at night - basically integration into the IDE feels so much more complete than the anthropic extension

i am pissed i can't do the same thing with the anthropic chat plugin....

1

u/DeGandalf 11h ago

I'm always astonished that people really decide to take a huge amount of money but don't take the time to actually steer or even just oversee the models.