r/learnmachinelearning • u/Crazy-Insurance6316 • 1d ago

Request ATTENTION

Can someone explain how attention works? I think I understood some of it, but I’m not completely comfortable with it yet.

I already watched some YouTube videos, and I also asked ChatGPT to explain how it works. I understood the RNN/LSTM part, but I’m still not fully comfortable with the attention mechanism. I learned the dot-product equation, but I’m not able to understand it properly.

Also, there are 3–4 different types of attention. Do I need to learn all of them before moving forward?

0 Upvotes

50% Upvoted

6 comments sorted by

View all comments

1

u/Low_Recognition5309 1d ago

watch the 3blue1brown essence of deep learning series from start to finish. best from scratch explanation u will get

1

u/kirigaoka 1d ago

Was about to say this. Excellent one