D3 · Backpropagation
One Neuron, By Hand
Compute every gradient in a single sigmoid neuron with a pencil.
Everything a training chip does for one neuron fits on the back of an envelope. Five numbers in, one number out, four gradients back. You are about to do all of it yourself.