Backpropagation, Nesterov Momentum, and ADAM Training (4.4)

The ADAM update rule can provide very efficient training with backpropagation and is often used with Keras. See how to calculate the ADAM update rule.

Code for This Video:
https://github.com/jeffheaton/t81_558_deep_learning/blob/master/t81_558_class_04_4_backprop.ipynb
Course Homepage: https://sites.wustl.edu/jeffheaton/t81-558/

Follow Me/Subscribe:
https://www.youtube.com/user/HeatonResearch
https://github.com/jeffheaton

Support Me on Patreon: https://www.patreon.com/jeffheaton

Source of this machine learning/AI Video

AI video(s) you might be interested in …