D7 · Neural Scaling Laws
Scaling at Inference Time
Compare spending compute during training against spending it per answer.
Every curve so far counts compute spent before the model meets anyone. There is a second budget. Let the model think longer on each question, or ask it many times and keep the best answer. That compute is spent again for every question.