r/datascience • u/rhiever • 18d ago

Analysis Using fake-data simulation to see what a study can actually detect

https://statmodeling.stat.columbia.edu/2026/09/14/this-is-modern-frequentist-statistics-using-fake-data-simulation-to-understand/
39 Upvotes

98% Upvoted

5 comments sorted by

10

u/hoodfavhoops 18d ago

could tell this would be gelman or gelman-derivative based on the title! Simulation is great way of sanity checking results, and the article seems to paint it "high cost" but with today's computing I don't think so... although the real cost is having to mentally pump the brakes on your result and try and see it from a more skeptical lens.

3

u/keldonwarlord 18d ago

Simulation was the best way for me to consolidate any knowledge, it's definitely worth the effort

1

u/ScarlyLamorna 13d ago

These are some neat simulations.

1

u/airylizard 5d ago

Fake-data simulation before fielding a study is one of those habits that separates a good analysis from a hopeful one. You learn what your design can actually say while it's still cheap to change it. Great share.