M5 · Did It Actually Work?
The Score That Lies
Say why a score measured on the training examples proves nothing, and what to hold back.
A model can score a perfect hundred and know nothing at all. Nobody has to make a mistake for this to happen. And the score is the one thing that will never tell you.