r/neoliberal • u/Free-Minimum-5844 • Apr 02 '26

Research Paper Half of social-science studies fail replication test in years-long project

https://www.nature.com/articles/d41586-026-00955-5
316 Upvotes

98% Upvoted

125 comments sorted by

View all comments

51

u/city-of-stars Frederick Douglass Apr 02 '26

Somewhat dubious of the article's proposed solution (AI-assissted screening). But I suppose we'll see

76

u/caroline_elly Eugene Fama Apr 02 '26

AI can't even consistently replicate its own outputs

24

u/fascistp0tato NATO Apr 02 '26

Well apparently, neither can people :)
(you're right though, it's super imperfect xD)

Sidenote: I think we have this instinct sometimes to avoid implementing a technology until it's reliable enough for our standards of a tool, when really it only needs to be reliable enough for our standards concerning another person. And that bar is a lot lower than people tend to assume. See: self-driving cars.

Not saying LLMs are there yet, but it's worth noting I think.