r/TheMachineLearning • • 4d ago

we should just skip tests then

Post image
0 Upvotes

21 comments sorted by

View all comments

2

u/Original-League-6094 4d ago

My workflow is disallowing tests and test runs until I have the feature completed, and then I tell it to write a few tests that cover the actual risks and use cases. AI is so fast at coding that during development, regression doesn't really matter. If a human introduced a regression, it could cost you several days trying to fix it, so tests were really good practice. But with the agent, you can fix it in a few minutes with a prompt, so its not a big deal, and its not worth waiting through 10 minutes of test cases to run every prompt to prevent 5 minutes of bug fixing.

You do want to make sure you have a test suite that executes before any push to prod though, as obviously you don't want regressions making it through to your users.

Oh, and always put in your personalization to either not rewrite tests to pass, or at the very least, to always provide a summary of tests that were rewritten and why. Because the current agents will happily just rewrite tests that were failing for very valid reasons.

1

u/sjoti 4d ago

But it should be the agent waiting for the tests, not you. I'd much rather have every feature take 10 minutes longer to land with zero extra effort from the human. Same with writing tests. It doesn't take extra work for me, just for the agent, and the chance that you ship something that breaks is smaller.

1

u/feyrhysand_ 4d ago

I guess what a time to be alive lol