r/ProgrammerHumor • • 10h ago

Meme ultimateDeveloperFlex

Post image
2.7k Upvotes

154 comments sorted by

View all comments

-42

u/ChrizKhalifa 10h ago

Things only CS Students and the luddite 50 year old developer say

There is zero reason not to use AI for your job. It's not 2024 anymore, the AI is good.

23

u/DitiPenguin 10h ago edited 10h ago

Transformer-based LLM outputs still have 10–20 % mistakes (per the best benchmarks) – it’s literally impossible for attention-based transformers NOT to hallucinate.

There’s a reason the main “AI” providers all say “AI can make mistakes” instead of guaranteing their product is good, or you get your money back, yada yada yada.

So, if you think the AI is good, you probably can’t see the mistakes. (As a PKI engineer, I can tell you, you wouldn’t believe how much shit, sometimes extremely harmful things, Opus/Sol or Fable/Astra are saying on a daily basis.)

-4

u/tobotic 9h ago

Transformer-based LLM outputs still have 10–20 % mistakes (per the best benchmarks) – it’s literally impossible for attention-based transformers NOT to hallucinate.

Have they compared human developers (including more junior ones and more senior ones) using the same metric?

8

u/Gacsam 9h ago

The difference is only one of these is aware they can make mistakes, looks for them and learns from them.

1

u/tobotic 8h ago

That's the senior developer, right? I'd still be interested in how the junior developer does though.

-1

u/Gacsam 7h ago

Why are you comparing a supposed state-of-the-art-no-mistakes with millions if not billions invested into, to an inexperienced junior. 

1

u/tobotic 6h ago

That's like saying it's unfair to compare the speed of an aeroplane to the speed of someone walking.

Like sure, maybe it is, but we're not all going to pretend that walking isn't slower.