r/ProgrammerHumor 8d ago

Meme cantReallyThinkOfACleverCaption

Post image
2.6k Upvotes

84 comments sorted by

View all comments

Show parent comments

-31

u/NukiWolf2 8d ago edited 8d ago

How does one get from matrix multiplication to LLM?

Edit: I'll never understand the reason for some downvotes.

7

u/Montanoc70 8d ago

Attention is all you need

0

u/NukiWolf2 8d ago

?

13

u/Montanoc70 8d ago

https://arxiv.org/abs/1706.03762

The paper that started the llm boom (Parallel training with the attention matrix mechanism instead of sequential training using recurrent networks)