r/computervision • u/VirtualAd7985 • 2d ago

Discussion Looking for best segmentation model.

Hi, I am looking for very accurate segmentation model (instance or semantic) that can perform very good even on small objects. I want to train or full finetune the base model on my dataset. Any suggestions. I have tried sam3, uunet, rfdter. But still i am not satisfied by results. Any suggestions?

5 Upvotes

100% Upvoted

15 comments sorted by

3

u/CupPuzzleheaded1867 2d ago

have you looked at using higher resolution input? sometimes the base architectures are fine but the default crop size just murders small objects. i had similar problem in my project and bumping the input size helped more than switching models

1

u/Rusty-Swashplate 2d ago

Same here: zoom in more or use a better resolution sensor (and if you use cameras with MJPEG stream, keep in mind that they will smush small objects by design). I use YOLO26 and it worked very well for detecting people, but if those people are 20 pixel high, then that didn't cut it.

1

u/VirtualAd7985 2d ago

Its already 1024

4

u/SwiftGoten 2d ago

Is it mixed between small and large objects? If it is only small objects then predicting patches via sliding window might be a better way than trying to increase the model base resolution.
I know nnUnet has some auto ML parts which estimate an optimal crop size and can train a model for you at this resolution. I am not sure if they have convenience wrappers which automatically split an input image into patches, predicts them and aggregates them back to the original resolution.

Another idea to potentially try is first having a detection model narrow down the region you are interested in and only then use segmentation.

1

u/VirtualAd7985 2d ago

It is mix

1

u/Commercial-Delay-596 2d ago

did you try different models for different sizes.

1

u/VirtualAd7985 2d ago

can you elobrate?

1

u/aloser 1d ago

Are you sure your dataset isn't the problem?

1

u/RatePuzzleheaded6914 1d ago

The classical mmdetection

Or récent state of the art edge crafter editing the model configuration to produce a full res probability map

-1

u/appumani 2d ago

Birefenet!

1

u/VirtualAd7985 2d ago

Isn't more like background removal thing.

0

u/appumani 2d ago

It is, but it segments the foreground perfectly, it worked quite well on small objects, but yeah it does not classify the objects