D2 · Gradient Descent
One Step Downhill
Write and run the gradient descent update, and explain what the learning rate controls.
You know where downhill is. Now decide how far to walk. Take the gradient, flip its sign, shrink it by some factor, then add it to the weights. Repeat. That shrinking factor is the learning rate.