D3 · Backpropagation
Every Model Is a Graph
Draw any expression as a graph of small operations.
A model with a hundred billion weights contains no clever operation. It adds. It multiplies. It compares two numbers. It exponentiates. That is the whole vocabulary.