R2 · Landmark Papers, Rebuilt
LeNet (1998)
Count what weight sharing saves, and say what LeNet-5 reported on digits.
Backpropagation could train a middle layer. It could not make images affordable. Wire every pixel to every hidden unit and a small photo costs millions of weights. Shift the digit one pixel and the pattern is new again.