M5 · Did It Actually Work?
Hunting Data Leakage
Run a leakage checklist over a pipeline and catch a column that will not exist at prediction time.
Your model hit 99 percent and the room went quiet. That silence is usually the sound of a column that will not exist tomorrow morning.