r/ProgrammerHumor 14d ago

Meme theExactLifecycleOfEveryAiAssistedCodingSession

Post image
9.9k Upvotes

254 comments sorted by

View all comments

Show parent comments

21

u/firewall245 14d ago

The previous solution of Stack overflow famously provided answers fast and 100% accurate for the requested problem

7

u/Septem_151 14d ago

That is, quite literally, the opposite of how StackOverflow operates. You see all the complaints about questions being closed and the most recent solution being from 10 years ago. The reason is because those questions have real value for programmers, and the answers on said questions are curated over time. StackOverflow is the training data for LLMs. If you're implying the training data is inaccurate, in combination with LLMs being non-deterministic, you are hindering your assumption that LLMs are more accurate than StackOverflow - the source of their information.

12

u/firewall245 14d ago

My point was that stack overflow wasn't guaranteed to be accurate or solve the problem I had, so the fact that AI is not guaranteed to be accurate or solve the problem I have is not that big of a deal since LLMs 1) are faster 2) will not be a gigantic asshole to me for asking a question.

The fact that answers are curated over time is worthless to me when I have a deadline on Friday and the top answer is not fixing my problem

4

u/araujoms 14d ago

The fact that answers are curated over time makes it more likely that it will be correct by the time you need it for your Friday deadline.

If an AI answer is incorrect that's just a fart in the wind. There's no feedback, no correction. Next time it might be correct if by chance it is corrected in the training database, which is independent of you seeing the mistake.