D3 · Backpropagation
Backprop in Matrices
Turn the by-hand rules into matrix formulas and check every shape.
The nine gradients you computed one at a time fit in three lines of matrix algebra. Every deep learning library runs those same three lines, for a model of any size.