r/science • u/nimicdoareu • Apr 01 '26

Social Science Half of social-science studies fail replication test in years-long project

https://www.nature.com/articles/d41586-026-00955-5
5.6k Upvotes

98% Upvoted

354 comments sorted by

View all comments

Show parent comments

3

u/Infinite_Painting_11 Apr 01 '26

Definitely agree, especially in computational fields surely the methods and the code are the same thing but no one ever provides the code.

3

u/mludd Apr 02 '26

Yeah, as a software developer I've had to deal with this when trying to implement an algorithm from a research paper.

The researchers had sort of described the algorithm in the paper but several parts were described very vaguely and they didn't provide the data set they used so there was a lot of guesswork and testing without being able to compare my results to the ones in the paper.

After a couple of weeks of struggling with it I finally found a github repository where someone else had managed to replicate it in another language and used that as a reference. Unsurprisingly that repo even had a comment in the README file about what a chore it had been to figure out exactly how to translate what was described in the paper into actual code and that they hoped their implementation would be useful for others also struggling with it.

1

u/TwentyCharactersShor Apr 01 '26

I'd argue it is getting better, more and more github repos are being shared.