Backpropagation, Nesterov Momentum, and ADAM Training (4.4)
The ADAM update rule can provide very efficient training with backpropagation and is often used with Keras. See how to calculate the ADAM update rule.
Code for This Video:
Course Homepage: https://sites.wustl.edu/jeffheaton/t81-558/
Tweets by jeffheaton
Support Me on Patreon: https://www.patreon.com/jeffheaton