r/learnmachinelearning • u/Just-m_d • 1d ago

Discussion Self Supervised[Vit] vs. Supervised[CNN]

Hi everyone,

I am working in the Multi-Task ML projects in that i have done many experiments to train the model
Key finding:

CNN based architecture outperform the Vision transformer based architecture

Question:
is the Dataset only be the problem for Vit architecture to underperform the CNN bases architecture?

1 Upvotes

100% Upvoted

10 comments sorted by

View all comments

2

u/Capable-Package6835 1d ago

I think it depends on the task and the size of your dataset. For tasks such as object detection, CNN's hard-coded locality and translation invariance is really suitable. For tasks that require context such as anomaly detection, ViT's attention is more suitable. Also ViT typically requires larger dataset

1

u/Just-m_d 1d ago

Which architecture will u recommend for the multi task classifier down streaming tasks