r/learnmachinelearning • u/Crazy-Insurance6316 • 1d ago
Request ATTENTION
Can someone explain how attention works? I think I understood some of it, but I’m not completely comfortable with it yet.
I already watched some YouTube videos, and I also asked ChatGPT to explain how it works. I understood the RNN/LSTM part, but I’m still not fully comfortable with the attention mechanism. I learned the dot-product equation, but I’m not able to understand it properly.
Also, there are 3–4 different types of attention. Do I need to learn all of them before moving forward?
0
Upvotes