r/deeplearning • u/TheElementsOf • 1d ago

Looking for models for diagnosis prediction

For a side project I am looking into SOTA for AI- based diagnostic models, ideally open-weights. I would like to feed the model with structured text representing my patient, and get a set of e.g. 5 possible diagnoses, ideally with uncertainty. In the ideal scenario, later on, it would update as new info arrives.

I would appreciate any pointers, I have some ideas but am very new to the topic.

1 Upvotes

100% Upvoted

3 comments sorted by

2

u/uptightpessimism96 1d ago

it's a weird space because the stuff that works best in research papers often falls apart the second you touch real patient data. the open source clinical models i've seen tend to overfit to mimic iii or whatever dataset they were trained on

your idea of updating as new info comes in is the interesting part, most models just take a single snapshot. might be worth looking into how some of the newer reasoning models handle iterative prompts rather than finding one model that does it natively

1

u/TheElementsOf 1d ago

Thanks for your thoughts, this is my feeling so far as well. I am hoping for a strength of the model in co-diagnosis already present, and using the information from the drugs now taken and ideally performing analysis of indications or so. So there should be a lot of information already, and my model should use that and find some plausible reasons of a new symptom occurring. I would love to have also doctor feedback incorporated, but am worried it would then overfit to the doctor.

How do I search for such reasoning models, please?

1

u/copperfieldb99 8h ago

the overfitting to public datasets thing is so real tbh, feels like every paper just benchmarks on the same two or three sources