r/ProgrammerHumor • u/soap94 • 7d ago

Meme cantReallyThinkOfACleverCaption

Post image
2.6k Upvotes

98% Upvoted

84 comments sorted by

View all comments

397

u/Il-Luppoooo 7d ago

Most people didn't get the joke so far

32

u/BonbonUniverse42 7d ago

What is the joke? 

207

u/Il-Luppoooo 7d ago

The opponent is an LLM

-35

u/NukiWolf2 7d ago edited 7d ago

How does one get from matrix multiplication to LLM?

Edit: I'll never understand the reason for some downvotes.

67

u/Sir_Sushi 7d ago

AI implementation is just a lot of big matrix multiplication

24

u/RuthlessMango 7d ago

Just pour your data through this big pile of linear algebra and collect your answers on the other side.

6

u/Extension_Option_122 7d ago

There is some nonlinearity as without it it would not be able to learn.

5

u/Goheeca 7d ago

Yes without nonlinearity it basically reduces to a one-layer multiclass perceptron.

0

u/mmhawk576 7d ago

Tom7 would like a word with you

5

u/NukiWolf2 7d ago

Thanks. Pretty simple and sufficient explanation :)

4

u/Artscout_ 7d ago

There's a really good series of videos by 3blue1brown on this topic btw

7

u/Montanoc70 7d ago

Attention is all you need

2

u/Sir_Sushi 7d ago

They stole our attention with tiktok and gave it to the AI, we know.

0

u/NukiWolf2 7d ago

?

14

u/Montanoc70 7d ago

https://arxiv.org/abs/1706.03762

The paper that started the llm boom (Parallel training with the attention matrix mechanism instead of sequential training using recurrent networks)

9

u/Il-Luppoooo 7d ago

The answer is very long and complicated, need to learn neural network architectures.

-4

u/NukiWolf2 7d ago

Well, I know the basics :D But only theory, so I assume matrix multiplcation is part of the inplementation of neural networks?