NeuroGenesys All reference videosAcademy • Reference video • 15:52Open on YouTube
Optimization for Deep Learning (Momentum, RMSprop, AdaGrad, Adam)
DeepBean
Why watch
How SGD grew into Adam, one fix at a time.
Featured in
Watch next
20:333Blue1BrownGradient descent, how neural networks learn | Deep Learning Chapter 2
Loss surfaces and descent, visually.
Watch
12:473Blue1BrownBackpropagation, intuitively | Deep Learning Chapter 3
What backprop computes, before the calculus.
Watch
2:25:52Andrej KarpathyThe spelled-out intro to neural networks and backpropagation: building micrograd
Build autograd yourself. The chain rule, organised, in code.
Watch
34:06Welch LabsWhat the Books Get Wrong about AI [Double Descent]
The overparameterization surprise from the generalization lesson.
Watch
Hosted by YouTube and played through its privacy-enhanced embed. The creator is not affiliated with NeuroGenesys; a video is a way in, not a source.
