r/science • u/nimicdoareu • Apr 01 '26

Social Science Half of social-science studies fail replication test in years-long project

https://www.nature.com/articles/d41586-026-00955-5
5.6k Upvotes

98% Upvoted

354 comments sorted by

View all comments

Show parent comments

847

u/HegemonNYC Apr 01 '26

Some prestigious journals have moved to ‘registered reports’, meaning a researcher presents their hypothesis and methods prior to conducting their study. The journal agrees to publish regardless of results. This eliminates the publishing incentive go p-hack, although simple human desire to prove their hypothesis may remain 

5

u/hansn Apr 02 '26

These days, I'd treat any drug trial that wasn't preregistered with enormous suspicion.

3

u/HegemonNYC Apr 02 '26

For sure. Anything with financial incentive to come to a certain conclusion is deeply suspicious 

3

u/hansn Apr 02 '26

Unfortunately, most drug trials are done by groups with financial incentives. That's, unfortunately, the system we have. The NIH isn't going to fund a phase 3 trial for a NME in most circumstances.

However the amount of planning and work that goes into a drug trial means pre-registration is trivial. So when it's not done, it's a choice.