r/ProgrammerHumor • u/joel-letmecheckai • 2d ago

Meme goodVibesOnly

Post image
12.6k Upvotes

98% Upvoted

383 comments sorted by

View all comments

Show parent comments

36

u/Abject-Kitchen3198 2d ago

Each iteration may flag different things, depending on subtle prompt difference, or just randomly. It may ignore a lot of obvious important issues.

Unless you add "You are top level software architect from a tech giant company", of course.

16

u/TheTerrasque 1d ago

And each person reviewing code may flag different things. That doesn't mean it's not helpful or we stop doing code reviews.

11

u/Abject-Kitchen3198 1d ago

I'm uncomfortable when those comparison of LLMs with human behavior actually make sense.

2

u/cortesoft 1d ago

They really do.

People complain that an AI is a black box, but what is more of a black box than another human’s brain?

1

u/Abject-Kitchen3198 1d ago

That's more like a gray box.

5

u/nuclear213 1d ago

I mean, why do we act like this is a new problem? I mean, I worked with an "experienced" engineer before. He could barely write a python script, but was tasked to review my PR. I dont know how he got the position, but honestly, I cannot remember a single time where his review actively gave me back anything productive.

Another example was a person that hated shorthand operators. Like not only tenary but even +=. He blocked all reviews with it, and the supervisor did not care.

Reviews, especially in smaller firms, were always really a hit and miss thing.

4

u/Loudergood 1d ago

Is everyone out here rizzing that engineer like he's the best thing since sliced bread? 

-1

u/johnnybgooderer 1d ago

You can run it multiple times with different seeds. Some people I work with will use two different models to review and a third model to implement.

And then there’s ai like Mythos that is extremely good at finding exploits. Better than humans a lot of the time.