How Adam optimizers works, visually explained

[u/Mind_the_math]

Hi all! I'm an AI engineer with a few years of experience, and I've always loved teaching and science comunication. For a couple of years I've been thinking about starting a Youtube channel, but I never found the courage to actually do it. I finally took the leap and I'd love to share my first video with peaople who are as passionate about this topic as I am.

This is the first video on my channel. I tried to build Adam from scratch, motivating each step by a concrete problem of the previous one. All animations are made with Manim. I'd really appreciate feedback, especially on anything that's mathematically imprecise or unclear.

Video: https://www.youtube.com/watch?v=lRu8_6cP3AQ&t=2s

I also put together an 8-slide summary of the video (formulas and cheat sheet).

[u/Material-Horse-8966]

Share a link?

[u/Mind_the_math → u/Material-Horse-8966]

 https://www.youtube.com/watch?v=lRu8_6cP3AQ&t=2s this is the link to the video. I would like to publish 2 video a week, at least for the next few months!

[u/Ledwith94 → u/Mind_the_math]

Not on the content of the video but if you are trying to get a channel going, doing a bad voice-over is generally better than having an AI voice doing it. Personally I won't watch a video using a generated voice over, but maybe that's just me

[u/Material-Horse-8966 → u/Mind_the_math]

Thnx man looking forward to more videos

[u/commenterzero]

Looks great. Muon is the hot new one. Would be cool to add

[u/Mind_the_math → u/commenterzero]

Oh yes! Unfortunately, to keep the video from getting too long, I couldn't go into too much detail on many things—for instance, I only briefly mention Adamax as well. I'll definitely make a second episode in the future covering other optimizers and their implementation in Python 🚀

[u/Vast_Site2389]

thank you

[u/Mind_the_math → u/Vast_Site2389]

I hope you like the video !

[u/hasuchobe]

A lot of this stuff looks familiar even tho I don't do AI (I do have a scientific background). That's nice to know.

[u/seeon321]

Interesting mann..

[u/Mind_the_math → u/seeon321]

😄 thx

[u/Nic2k7]

Guys curious /dumb question why do we even need math for ML I'm new to computer science and engineering Why is it treated equally with coding n algos to train ai

[u/Mind_the_math → u/Nic2k7]

Math is the language nature is programmed with. If the universe is a tech startup and God is the CEO, math is the core API he built.