D10 · Learning by Trying
Too Many Squares for a Table
Explain how a network replaced the Q table, and what DQN needed to keep that network from falling apart.
Our grid has seventeen squares. An Atari screen is 210 by 160 dots, each in one of 128 colors. There are more possible screens than atoms in the universe. No table can hold them.