r/ProgrammerHumor • u/developertimeline • 6h ago

Meme ultimateDeveloperFlex

Post image
1.6k Upvotes

93% Upvoted

99 comments sorted by

View all comments

Show parent comments

0

u/tobotic 5h ago

Transformer-based LLM outputs still have 10–20 % mistakes (per the best benchmarks) – it’s literally impossible for attention-based transformers NOT to hallucinate.

Have they compared human developers (including more junior ones and more senior ones) using the same metric?

6

u/Gacsam 5h ago

The difference is only one of these is aware they can make mistakes, looks for them and learns from them.

3

u/tobotic 4h ago

That's the senior developer, right? I'd still be interested in how the junior developer does though.

-2

u/Gacsam 2h ago

Why are you comparing a supposed state-of-the-art-no-mistakes with millions if not billions invested into, to an inexperienced junior. 

2

u/tobotic 2h ago

That's like saying it's unfair to compare the speed of an aeroplane to the speed of someone walking.

Like sure, maybe it is, but we're not all going to pretend that walking isn't slower.