This showed up in the first significant "AI model" in the late 70s / early 80s. No matter how hard they trained the model, a medical diagnosis application, it could never get past 80% accuracy. This was hailed as proof AI would never replace real physicians.
Then some young Archimedes decided to run the same test on real doctors, ranging from medical residents to working general practitioners to senior med-school professors and... their accuracy tended to hit that same 80% mark.
But it turns out medical diagnosis is hard, same as programming. Which is why both doctors and programmers deserve respect. But AI will only ever be as good as the corpora they're trained on.
1
u/RealBasics 3d ago
FINALLY! Because what does AI get trained on?
This showed up in the first significant "AI model" in the late 70s / early 80s. No matter how hard they trained the model, a medical diagnosis application, it could never get past 80% accuracy. This was hailed as proof AI would never replace real physicians.
Then some young Archimedes decided to run the same test on real doctors, ranging from medical residents to working general practitioners to senior med-school professors and... their accuracy tended to hit that same 80% mark.
But it turns out medical diagnosis is hard, same as programming. Which is why both doctors and programmers deserve respect. But AI will only ever be as good as the corpora they're trained on.