D2 · Gradient Descent
Too Big, Too Small
Recognize divergence and crawling from a loss curve, and know the range of learning rates that can work.
Walking downhill in fog has two failure modes, and they look nothing alike. Stride too short: you are still on the hillside at sunrise. Nothing is broken. You are just slow.