R2 · Landmark Papers, Rebuilt
Sequence to Sequence (2014)
Explain the fixed-vector bottleneck, and why reading the source backward helped.
A plain network takes a fixed number of inputs and gives a fixed number of outputs. A sentence obeys neither rule. So machine translation was built from phrase tables and counting, with a neural net bolted on at most as a scorer.