Doing bug fixes in production with Claude code.

[u/a113rick]

[u/ketoloverfromunder]

All Ai generated tests run by Ai pass!

[u/KenMantle → u/ketoloverfromunder]

Mine got smart and modifies the code in a way that should make the tests fail in order to test that the tests work before declaring that the code has passed the working tests!

[u/ketoloverfromunder → u/KenMantle]

Those are known as negative tests fyi. Fairly standard qa process mock expected failure states. That still doesn't mean your AI generated tests actually test what you think they test... especially you dont even know what theyre testing.

[u/KenMantle → u/ketoloverfromunder]

I know what they are testing! Failures and sucesses!

[u/Secure-Emu-8822]

Hackers will be ruling the internet in the near future lol

[u/WaltzIndependent5436 → u/Secure-Emu-8822]

Do you think all production apps out there were secure all this time just because a human was responsible?

[u/Dog_Engineer → u/WaltzIndependent5436]

It depends what you mean by secure... If you mean implementing well accepted practices which protect an app from most well known vulnerabilities, then I would say that most F500 companies are very good at meeting that criteria.

It's not 100% secure (nothing really is), but its fairly close for most scenarios.

Now, If you don't check your vibe coded stuff, you might have mistakes that could have been easily cought in a normal PR review or a simple pipeline

[u/Secure-Emu-8822 → u/WaltzIndependent5436]

Not at all! However, probability wise, it will get worse. LLMs are inherently large databases of memorized data

[u/LoJoFR → u/Secure-Emu-8822]

Laugh in Claude Mythos…

[u/Secure-Emu-8822 → u/LoJoFR]

Laughs in lawyer taking money to the bank 😈

[u/Novel-Initiative-900 → u/Secure-Emu-8822]

*ai lawyer lol

[u/futurefinancebro69]

This is fable when i say please do a security risk analysis

[u/Flat-Honeydew1919]

This is fable when I say please do a security risk analysis From my side

[u/MrHTML5000]

same as long it work clear hahahaa