M5 · Did It Actually Work?
Splits That Respect Reality
Split by group or by time whenever a random split would let the model recognize what it already saw.
Ten thousand rows, five hundred patients. Your random split put the same patient on both sides. The model did not learn medicine. It learned to recognize people.