D3 · Backpropagation
Chaining Backwards
Multiply local gradients along a path to get any weight's gradient.
A weight ninety layers below the loss still gets an exact gradient. Not an estimate. The recipe is ninety small multiplications, and every one of them was already computed on the way up.