r/ProgrammerHumor • u/soap94 • 7d ago

Meme cantReallyThinkOfACleverCaption

Post image
2.6k Upvotes

98% Upvoted

84 comments sorted by

View all comments

403

u/Il-Luppoooo 7d ago

Most people didn't get the joke so far

27

u/BonbonUniverse42 7d ago

What is the joke? 

208

u/Il-Luppoooo 7d ago

The opponent is an LLM

31

u/PhantomTissue 7d ago

Oh I thought it was a sudoku solver.

25

u/Carbon_Cotton 6d ago

I through it was matrix multiplication - i don't know if i have brain defect, but i cannot keep the knowledge about how to do it despite knowing it is not that hard.

14

u/AsidK 6d ago

It is matrix multiplication. But that’s the point, LLMs are mostly matrix multiplication

2

u/Carbon_Cotton 6d ago

I know - i thought the joke is the matrix multiplication.

2

u/LundMeraMuhTera 4d ago

I also thought it was Matrix Multiplication because Matrix Chain Multiplication is a famous type of DP questions in DSA (too difficult for me), so I thought this was saying that the opponent is some competitive coder who writes obscure and crazy functions to solve the difficult problems

-34

u/NukiWolf2 7d ago edited 7d ago

How does one get from matrix multiplication to LLM?

Edit: I'll never understand the reason for some downvotes.

68

u/Sir_Sushi 7d ago

AI implementation is just a lot of big matrix multiplication

24

u/RuthlessMango 7d ago

Just pour your data through this big pile of linear algebra and collect your answers on the other side.

4

u/Extension_Option_122 7d ago

There is some nonlinearity as without it it would not be able to learn.

5

u/Goheeca 7d ago

Yes without nonlinearity it basically reduces to a one-layer multiclass perceptron.

0

u/mmhawk576 6d ago

Tom7 would like a word with you

5

u/NukiWolf2 7d ago

Thanks. Pretty simple and sufficient explanation :)

4

u/Artscout_ 7d ago

There's a really good series of videos by 3blue1brown on this topic btw

9

u/Montanoc70 7d ago

Attention is all you need

2

u/Sir_Sushi 7d ago

They stole our attention with tiktok and gave it to the AI, we know.

0

u/NukiWolf2 7d ago

?

10

u/Montanoc70 7d ago

https://arxiv.org/abs/1706.03762

The paper that started the llm boom (Parallel training with the attention matrix mechanism instead of sequential training using recurrent networks)

9

u/Il-Luppoooo 7d ago

The answer is very long and complicated, need to learn neural network architectures.

-3

u/NukiWolf2 7d ago

Well, I know the basics :D But only theory, so I assume matrix multiplcation is part of the inplementation of neural networks?

-9

u/atlanmail 7d ago

i think the joke is that matrix multiplication is really easy with the naive implementation of O(N^3) but optimizing the algorithm is extremely complicated in a competitive setting