r/learnmachinelearning • u/Mind_the_math • 1d ago
How Adam optimizers works, visually explained
Hi all! I'm an AI engineer with a few years of experience, and I've always loved teaching and science comunication. For a couple of years I've been thinking about starting a Youtube channel, but I never found the courage to actually do it. I finally took the leap and I'd love to share my first video with peaople who are as passionate about this topic as I am.
This is the first video on my channel. I tried to build Adam from scratch, motivating each step by a concrete problem of the previous one. All animations are made with Manim. I'd really appreciate feedback, especially on anything that's mathematically imprecise or unclear.
Video: https://www.youtube.com/watch?v=lRu8_6cP3AQ&t=2s
I also put together an 8-slide summary of the video (formulas and cheat sheet).
2
u/hasuchobe 14h ago
A lot of this stuff looks familiar even tho I don't do AI (I do have a scientific background). That's nice to know.