M3 · Twenty Questions
A Tree That Memorizes
Grow a tree until it memorizes the training set and see the test error rise.
Let a tree ask more questions and its score on the rows it studied only climbs. Give it room and it hits a hundred percent. On rows it has never seen, the best score comes early. After that it slides.