D7 · Neural Scaling Laws
Spending a Compute Budget
Split a fixed budget between model size and tokens, with a reason.
Someone hands you a cluster for three months. Two numbers decide what you build with it, and both come out of one square root. This lesson is that calculation, and then the three reasons real teams ignore it.