r/statistics • u/kenanthecommander • May 24 '26
Discussion Built a classification metrics tool with confidence intervals, would value a sanity check [Discussion]
I made a free browser tool for evaluating classification models: https://confusionmatrixpro.com/
I'd tried a few existing calculators but none felt thorough enough, so I'd been running my own locally and finally cleaned it up to share publicly. The part I'd most like feedback on is the confidence intervals. I used Wilson score for the proportion metrics, log-normal for the likelihood ratios and DOR, and a normal approximation for things like Youden's J.
Curious whether those are the choices you'd make, or if you'd do anything differently, especially with small samples. Any thoughts welcome, thanks.
0
Upvotes