F4 · Reading Data Honestly
Decide the Size Before You Look
Design an A/B test with a sample size fixed in advance, and say why peeking breaks it.
Two thousand visitors in each half, and both halves got exactly the same page. This line is the gap between them, watched as the visitors arrived.