M6 · What to Show Next
Offline Wins, Online Losses
Say why a better offline score can lose a live test, and read a live result before shipping.
An offline score guesses what people would have done. A live test measures what they do. Split people at random: half get the old feed, half the new, on the same days. You met this A/B test in F4.