L10 · Smaller, Faster, Cheaper
Cutting Weights
Prune a layer three ways and say which pattern a chip can actually skip.
Half the weights in this layer are now zero, and its output moved by 28 percent. Zero the same number in neat blocks and the output moves more. Yet only the neat blocks make the chip faster.