Tag: neural nets
-
Proving the Gradient Descent Exercise (Neural Networks and Deep Learning)
Chapter 1 of Neural Networks and Deep Learning by Michael Nielsen presents the following question. How should we choose a vector of changes (of fixed magnitude) in order to minimize or, to analogize, suppose you are at the top of a hill looking to find the fastest way down. What direction should you take a…