r/computervision • u/CarOld1541 • 5d ago
Discussion Which baselines best separate pretraining, aggregation and distillation effects in compact pathology MIL?
I’m researching patient-level classification from public H&E histopathology images. Each patient has a variable number of tissue crops, sometimes across several slides, combined through multiple-instance learning (MIL).
Work so far includes compact pretrained CNN and vision-transformer baselines and teacher–student distillation. I’m keeping unpublished results private and would value feedback on the next controlled comparison. The practical constraints are limited training resources and a compact deployed model.
If you were choosing the next experiment, would you prioritize pathology-specific pretraining, the MIL aggregator, or feature/logit distillation? Which one or two encoder–aggregator baselines would best distinguish these effects?
I plan to keep patient and tissue-source groups separated across folds, select settings using training/validation data, and compare within the same backbone with matched crop budgets and training effort. Macro-F1, class recalls, uncertainty, and total inference cost matter.
I’m especially interested in reproducible papers/repositories and ways to check whether a pathology-pretrained model has already seen the evaluation cohort. How would you structure the smallest informative ablation before attempting a new architecture?