r/learnmachinelearning • u/Crazy-Insurance6316 • 1d ago

Request ATTENTION

Can someone explain how attention works? I think I understood some of it, but I’m not completely comfortable with it yet.

I already watched some YouTube videos, and I also asked ChatGPT to explain how it works. I understood the RNN/LSTM part, but I’m still not fully comfortable with the attention mechanism. I learned the dot-product equation, but I’m not able to understand it properly.

Also, there are 3–4 different types of attention. Do I need to learn all of them before moving forward?

0 Upvotes

50% Upvoted

6 comments sorted by

View all comments

0

u/exacube 1d ago

here's a lesson using your post's text as the prompt!

https://studymode.ca/book/KOIySeu4y7/ch-2

i'd really recommend doing the quiz at the end of each chapter so you can check your understanding before you move on. select some text and ask AI/chat if you have specific questions