D2 · Gradient Descent
Knowing When to Stop
Read a loss curve and decide whether to keep going, cut the learning rate, or stop.
In a textbook, descent converges when the gradient reaches zero. In practice you never get there, and you do not need to. You stop when the next bit of progress is not worth the time and the electricity.