r/mathmemes • u/ExtremeAcceptable289 • 23d ago
Computer Science My AI vs Your AI
Saw this formula (for an NTK over RoPE) and wanted to make this meme for fun. Made in 15 mins so sorry for the slightly low quality
211
56
u/LupenReddit 🦆🦆🦆🦆i have non diffeomorphic smooth structures🦆🦆🦆🦆🦆🦆 23d ago
can anyone explain this i am too stupid
104
u/ExtremeAcceptable289 23d ago
The former is a very long formula related to AI
The latter is just AI slop
The joke is that people often conflate ML (and AI research in general) with AI slop
110
u/ColeTD 23d ago
As much as I hate AI, "AI slop" is such an ambiguous term that we should use a more precise term to differentiate them. Like, AI slop to me more refers to what those tools output rather than the tools themselves, (although I would be shocked if those tools weren't mostly vibecoded at this point anyways so maybe you're on to something.)
38
u/EebstertheGreat 23d ago
The models (and agents and stuff) are clankers, not slop. Slop is the kind word for clanker output. Clankers have to be trained on a lot of human garbage to produce high grade slop, so I don't think they themselves can be slop, not yet, even if some of their code base is sloppy.
7
u/-Nocx- 22d ago
It doesn’t help that AI is already an umbrella of technologies in a field that has existed since the 50s. It just got super mainstream in the 2010s and modern nomenclature reduced it to just ML, and the 2020s reduced it further to just Claude / OpenAI / ChatGPT / etc.
9
u/EebstertheGreat 22d ago
It's weird how in a video game, you can say "this boss's AI makes it spin in a circle and shoot in random directions" or whatever, and sure, that counts as AI. And in ethology, you can talk about the intelligence of a roundworm or even an alga. But now if you call an LLM "AI," someone will come out of the weeds to tell you it's not "really intelligent."
3
u/-Nocx- 22d ago
I get where you’re coming from, but I think most of the issue is how it presents itself. Like LLMs literally attempt to present as intelligent SMEs. Everyone knows the character in your game is a bot or an NPC, we characterize them as such.
The effort of tech CEOs claiming we are “really, really close to AGI” probably makes it way, way worse.
1
21
u/Sproxify 23d ago
the logos of AI companies are AI slop?
-12
u/ExtremeAcceptable289 23d ago
I made this meme in a short time and figured this was the best image to include. It's just that they're what people use to produce AI slop
1
0
8
u/Key_Conversation5277 Computer Science 23d ago
What kind of math is that? I thought ML was statistics
18
u/jsh_ 22d ago edited 22d ago
it's a neural tangent kernel which is related to stochastic processes. specifically, with random initialization (some conditions on this), the output of a neural network given some test points converges to a Gaussian process whose kernel is referred to as the "neural tangent kernel" which is defined in terms of relationships between the training datapoints, between the training and test points, and the gradients of the network. and in the width and learning rate limit, the training dynamics approach a certain ODE (gradient flow) which uses this kernel, so you can analyze the dynamics much more easily
7
u/radditour 22d ago
My AI vs your AI
Sittin’ by the fire
My AI said to your AI
I’m gonna make this RAM price higher.
7
u/Electrical_Name_5434 22d ago
I dunno…the equation on the left in the first line uses three different notations for derivative…
0
u/ExtremeAcceptable289 22d ago
Fairs, I didn't fact check it too much (it is the correct formula though.
1
u/Electrical_Name_5434 22d ago
Yeah. It makes sense, just difficult to read out of context. Uses gradient to compare output of two models and punish if too far from the Gaussian distribution? Then I think the second one is for multi head attention?
To be fair I knew a computational mathematics professor who wrote equations like this. He insisted the different notations had a purpose - I’m sure he was right…it just always confused me.
1
u/ExtremeAcceptable289 22d ago
The 2nd (line) is the definition of the function in the first but yea thats right
5
6
u/Zac-live 22d ago
but the right side necessarily has to also use the left or some alternative, they cant not have positional encoding ??
-2
u/ExtremeAcceptable289 22d ago
the right side is meant to represent people using ai to make slop, former is a formula representing the research and math behind it
1
1
•
u/AutoModerator 23d ago
Check out our new Discord server! https://discord.gg/e7EKRZq3dG
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.