D7 · Neural Scaling Laws
Compute, Data, Parameters
Explain how the three inputs trade against each other for a fixed loss.
Every training run has three numbers: the model's parameters, the tokens it reads, and the compute all that costs. The third is not a separate dial. It is the bill for the first two. You set two, and the bill sets itself.