R3 · Open Problems
Running It Without Fooling Yourself
Run the comparison with seeds and a baseline, and read the result honestly.
Your idea may well beat the baseline on its first run. An idea that does nothing wins its first run about half the time too. One run is a coin toss.