R2 · Landmark Papers, Rebuilt
Word2Vec (2013)
Build word vectors from company alone, and test the analogy claim honestly.
In most language systems before this, a word was a slot number. Word 4,012 and word 4,013 had nothing to do with each other. So a model that had read about hotels knew nothing about motels. Every word had to be learned alone.