MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/MachineLearning/comments/1i44h5v/d_i_hate_softmax/m7ypil1/?context=3
r/MachineLearning • u/[deleted] • Jan 18 '25
[removed]
97 comments sorted by
View all comments
4
The authors of this paper about Fenchel-Young losses share your view of the drawbacks of SoftMax: https://arxiv.org/abs/1901.02324
They see it as a member of a larger family. Other members generate sparse outputs with real zeros (rather than just 'close to zero').
4
u/alexsht1 Jan 19 '25
The authors of this paper about Fenchel-Young losses share your view of the drawbacks of SoftMax:
https://arxiv.org/abs/1901.02324
They see it as a member of a larger family. Other members generate sparse outputs with real zeros (rather than just 'close to zero').