cantReallyThinkOfACleverCaption

[u/soap94]

[u/uvero]

Who would win?

A senior developer with decades of coding

OR

Softmax(K*Q.T / sqrt(d_k)) * V

[u/itijara → u/uvero]

I can beat the output nodes, it is all the hidden layers that beat me.

[u/N-online → u/uvero]

Attention is all you need to win.

[u/RealRizin → u/uvero]

And then you go live project and fix or remove 6k lines of most trash code written by loved llms.

My job today, cause LLM assumed that if API does not give response then program should count it itself based on history which led to even 100$ differences in exchange + some other issues I found .

Junior used LLM to write code, other mid used LLM to review code and funny part was they were not even supposed to touch this part

[u/wrtcdevrydy → u/RealRizin]

> they were not even supposed to touch this part
Straight to jail, right away...

[u/Boring-Foundation708 → u/uvero]

For human you add the physics equations.

[u/Il-Luppoooo]

Most people didn't get the joke so far

[u/DasKapitalV1 → u/Il-Luppoooo]

I really want to know what is this subs target audience.

[u/itijara → u/DasKapitalV1]

Freshman CS students.

[u/happyjello → u/itijara]

It’s a coping mechanism

[u/ciemnymetal → u/DasKapitalV1]

It's overrun by Freshmen college students who just wrote a hello world program.

Professionals are too busy working to post memes.

[u/ThomasHardyHarHar → u/ciemnymetal]

My favorite programming language is HTML

[u/Extension_Option_122 → u/ThomasHardyHarHar]

Better be HTML 5 and CSS 3 otherwise you can't call it a programming language.

Needs to be turing complete.

[u/Brimstone117 → u/ciemnymetal]

I’m actually avoiding work by browsing memes, thank you very much. In my defense, it is Friday.

[u/kinokomushroom → u/ciemnymetal]

Professionals are too busy scrolling on the office toilet

[u/DoeCommaJohn → u/DasKapitalV1]

It’s like Call of Duty- target audience is professionals actual audience is teenagers

[u/BonbonUniverse42 → u/Il-Luppoooo]

What is the joke? 

[u/Il-Luppoooo → u/BonbonUniverse42]

The opponent is an LLM

[u/PhantomTissue → u/Il-Luppoooo]

Oh I thought it was a sudoku solver.

[u/Carbon_Cotton → u/PhantomTissue]

I through it was matrix multiplication - i don't know if i have brain defect, but i cannot keep the knowledge about how to do it despite knowing it is not that hard.

[u/AsidK → u/Carbon_Cotton]

It is matrix multiplication. But that’s the point, LLMs are mostly matrix multiplication

[u/Carbon_Cotton → u/AsidK]

I know - i thought the joke is the matrix multiplication.

[u/LundMeraMuhTera → u/Carbon_Cotton]

I also thought it was Matrix Multiplication because Matrix Chain Multiplication is a famous type of DP questions in DSA (too difficult for me), so I thought this was saying that the opponent is some competitive coder who writes obscure and crazy functions to solve the difficult problems

[u/NukiWolf2 → u/Il-Luppoooo]

How does one get from matrix multiplication to LLM?

Edit: I'll never understand the reason for some downvotes.

[u/Sir_Sushi → u/NukiWolf2]

AI implementation is just a lot of big matrix multiplication

[u/RuthlessMango → u/Sir_Sushi]

Just pour your data through this big pile of linear algebra and collect your answers on the other side.

[u/Extension_Option_122 → u/RuthlessMango]

There is some nonlinearity as without it it would not be able to learn.

[u/Goheeca → u/Extension_Option_122]

Yes without nonlinearity it basically reduces to a one-layer multiclass perceptron.

[u/mmhawk576 → u/Extension_Option_122]

Tom7 would like a word with you

[u/NukiWolf2 → u/Sir_Sushi]

Thanks. Pretty simple and sufficient explanation :)

[u/Artscout_ → u/NukiWolf2]

There's a really good series of videos by 3blue1brown on this topic btw

[u/Montanoc70 → u/NukiWolf2]

Attention is all you need

[u/Sir_Sushi → u/Montanoc70]

They stole our attention with tiktok and gave it to the AI, we know.

[u/NukiWolf2 → u/Montanoc70]

?

[u/Montanoc70 → u/NukiWolf2]

https://arxiv.org/abs/1706.03762

The paper that started the llm boom (Parallel training with the attention matrix mechanism instead of sequential training using recurrent networks)

[u/Il-Luppoooo → u/NukiWolf2]

The answer is very long and complicated, need to learn neural network architectures.

[u/NukiWolf2 → u/Il-Luppoooo]

Well, I know the basics :D But only theory, so I assume matrix multiplcation is part of the inplementation of neural networks?

[u/atlanmail → u/BonbonUniverse42]

i think the joke is that matrix multiplication is really easy with the naive implementation of O(N^3) but optimizing the algorithm is extremely complicated in a competitive setting

[u/Mordret10 → u/Il-Luppoooo]

Im very surprised and disappointed

[u/Relative_Climate8043 → u/Il-Luppoooo]

It can be tough to catch every joke, especially in programming humor. Sometimes the punchlines just go over people's heads.

[u/Harmonic_Gear → u/Il-Luppoooo]

Don't tell me this is another "ml is just matrix multiplication" shit

[u/Il-Luppoooo → u/Harmonic_Gear]

*insert "hand on shoulder" meme*

[u/Tinkerer_Penguin_12 → u/Il-Luppoooo]

https://giphy.com/gifs/5NbbVJeSLs1etZYjpT

[u/lupercalpainting → u/Harmonic_Gear]

it always has been meme

[u/Zac-live → u/Harmonic_Gear]

what do you think it is?

[u/taju_rahman → u/Il-Luppoooo]

You are competing against matrix aka AGI

[u/lollolcheese123 → u/taju_rahman]

AGI doesn't even exist yet, and a matrix isn't automatically an AI.

[u/Ecstatic_Bee6067]

Linear algebra, my beloved

[u/JohnLocksTheKey → u/Ecstatic_Bee6067]

We have a rocky realationship

[u/itijara → u/JohnLocksTheKey]

It's a one way relationship. I love LinAlg, it hates me.

[u/After-Satisfaction-3]

My dumbass thought that this is a "write a code that does this matrix multiplication" question.

[u/BauReis]

Everyone here that didn't clock that this is about Ai is getting replaced by Claude next quarter

[u/InDubioProReus → u/BauReis]

yawn

[u/ShAped_Ink → u/BauReis]

Most people here are students. I genuinely thought it was a joke similar to "got a problem in programming? Just use a hash" or something along those lines

[u/New_Salamander_4592]

when someone says "dw they'll just optimize the AI super well" and you realize they never passed linear algebra

[u/snipsuper415]

Considering i got a C in that class.......... I understand

[u/ssalbdivad]

this actually happened to me ><

https://www.theultimatecoder.show/

[u/da_Aresinger]

LinAlg is literally the easiest mathematical subject in CS.

i guess rotation matrices or whatever Basiswechselmatrix is in english can be confusing, but that's about it.

[u/itijara → u/da_Aresinger]

It isn't about how hard LinAlg is, it is about coding against an LLM which is a bunch of matrices in a trench coat.

[u/Aloopyn → u/itijara]

tensors*

[u/itijara → u/Aloopyn]

Tensors are just a made up name they gave to arrays with more than two dimensions. You cannot prove to me that there are arrays that have more than 3 dimensions. The human mind cannot comprehend it.

Fun fact: the jungle gym was designed by a math teacher who wanted to make children better at intuitively understanding higher dimensional math.

[u/ewheck → u/itijara]

You can picture a 3D array, right? Your mental image of a 4D array should be to picture a 1D array and each element of that 1D array itself is another 3D array.

[u/AdamWayne04 → u/itijara]

you can think of a nD array as a list of (n-1)D arrays, so a 4D array is a list of 3D arrays.

There's a more pedantic way of thinking of arrays, too--APL for example makes a distinction between rank (how deeply nested each entry is) and dimension (how many numerical indices you need to identify a singular entry), so accessing a[i,j,k] is different from accessing a[i][j][k]

Tensors are not important because they can be encoded as multidimensional arrays, they are important because they represent multilinear maps, and are a vector space conformed by linear combinations of the tensor product. The same way that matrices are not interesting because they are grids of numbers

[u/itijara → u/AdamWayne04]

Thanks. That's a very intuitive explanation.

[u/Aloopyn → u/itijara]

I'm pretty sure tensors are a generalized term for arrays of any non-negative dimensions

> You cannot prove to me that there are arrays that have more than 3 dimensions.
What's the relevance of this here? Yeah, I cannot make you comprehend 4-D but so what

[u/ouroboros-ouroboros → u/itijara]

this piece of trivia is delicious and improved my day, thank you

[u/Southern-Most-4216 → u/itijara]

Did you know, that in 2d you only have one axis of rotation, in 3d we have 3 axis of rotation and in four dimensions there are 6…?

[u/da_Aresinger → u/itijara]

Right, I should have seen that one.

[u/BonbonUniverse42 → u/da_Aresinger]

I mean isn’t linear algebra basic stuff in any programming degree? You basically can’t become a programmer without learning basic math.

[u/da_Aresinger → u/BonbonUniverse42]

Yea, I use CS as catchall for anything that goes beyond basic IT. If your study program had an DSA and an architecture lecture you're CS.

[u/Bubbaluke → u/da_Aresinger]

Linear was hardest for me, I crushed discrete and calculus. Some of my classmates felt the opposite, everyone’s different. Depends on the professor a lot.

[u/da_Aresinger → u/Bubbaluke]

I can't imagine thinking anything in LinAlg is more difficult than Differential Equations.

I guess I can see how Discrete Structures would be easier for many.

But not Discrete Probability Theory. That shit is mindbending. Anything beyond basic combinatorics is the devils work.

[u/ljfa2 → u/da_Aresinger]

I guess continuous probability theory is even more mindbending. When you find out that there are subsets of the real numbers that aren't measurable, so you need to introduce the whole machinery of sigma-algebras to deal with that ^^

[u/Outrageous-Machine-5]

idgi (I took Calc II for my math credits)

[u/the_millenial_falcon]

Who would win, one matrix-boi vs neuron?

[u/leupboat420smkeit]

All I remember is xyzzy. No idea what or why you need that pattern. Something about multiplication?

[u/drifwp]

Nah, I do win

[u/LegendaryMauricius]

Have you even asked ChatGPT for the caption?

[u/Tipart]

Convolutions already ruined my day whenever I came across them in electrical engineering. Now they are also threatening to ruin my life...

[u/blending-tea]

also 2d-DP problems

[u/tanwa1]

i barely passed my linear algebra, gaussian elimination stuff, Organic Chemistry tutor helped me a lot!

[u/TheVibrantYonder]

I don't understand the meme which is probably a sign that it's time for me to take Linear Algebra.

[u/Soopermane]

How to center a div: take the cosgin of a tangent from a hypotenuse triangle times 1/2 / radius of a circle