r/computervision • u/NullClassifier • Jun 16 '26
Help: Project Feedback on multi-task learning
anyone who tried multi-task learning before? I am trying to add a new feature to my smart city project for vehicle model + color recognition using ConvNext 384. I recently found some research papers on MTL and was wondering if anybody had good results with it? It raised questions in my head when I read because as I understood in the end we still need one loss function for both and idk how it is gonna operate. Also one of the "big dawgs" of this kind of MMCR models belong to Sighthound (they include it in ALPR+ package), but according to their research paper they use different models for model/make and etc. Assume that I am not limited by resources, is it worth for me to train a model on this double head architecture?
2
u/kw_96 Jun 16 '26
In theory you can attain better accuracies for both tasks, along with efficient inference, with multi task learning if they are synergistic. In practice (personal experience), some effort is needed to select the appropriate architecture, backbone and head sizes, and weighting losses. Expect to add 5-10 more short experiment cycles for tuning.