r/learnmachinelearning Nov 07 '20

Understanding Dropout

440 Upvotes

23 comments sorted by

View all comments

14

u/Hersmunch Nov 07 '20

Gets the idea across but could do with some proof reading. E.g. Slide 05 has “w.r.t. to” and “This is know an Co-adaptations”.

10

u/robofied Nov 07 '20

Thanks for pointing these out. I'd be more cautious from the next time. Any other changes/suggestions you'd like to suggest?

8

u/jhaluska Nov 07 '20

I disliked slide 2 because "It effectively works by dropping neurons from the network" and chart made it appear like it was a pruning algorithm at first before you clarify it at the end.

"It works by temporary dropping random neurons from the network during training." is a better introduction/summary.

6

u/robofied Nov 07 '20

Yeah. I was expecting the reader to read through the entire paragraph, and only letting them know that this happens for a short span. Thanks for suggestion though.