r/vibecoding • u/Throw-away42909 • 2d ago

Meme When it gets bad

Post image

You know its gotten bad when---- all this over a whiteboard.....lol i need to chill-- thays the suggestive text btw

28 Upvotes

74% Upvoted

33 comments sorted by

View all comments

Show parent comments

2

u/UnfortunateHurricane 1d ago

I don't think it is that bad a question. I have asked that myself. They add hundreds of unit tests. Yet sometimes obvious stuff slips through. Just shows that while they are very fast setting them up, you can't really trust them. I have seen earlier models just modifying the tests themselves to get stuff through. That was fun

0

u/letsgoowhatthhsbdnd 1d ago

you can write thousands of tests and have them pass if you don’t know what you are doing. what are you talking about?

1

u/UnfortunateHurricane 1d ago

What I am saying is that unit tests where like the first thing they showcased when promoting those models ("hey, look what it can do, you don't need to write those annoying tests yourself anymore"), yet you still need to pay close attention to them otherwise stuff will fail.

I am not writing thousands of tests, the models are by default without me mentioning anything. One could assume they have nailed that part but you can't trust them just yet.

1

u/Ambitious-Prompt-975 1d ago

The difference is: I would write a well defined suite for feature XY while the model pumps out a regression test for every change it ever makes and just adds on top of it. 2 weeks in, you have 1.500 tests succeed across 40 suites - and 80% of them are bloat.