D7 · Neural Scaling Laws
Emergence and Its Critics
Explain how metric choice can manufacture a sudden jump in ability.
Three-digit addition. Models below a certain size score about zero. Bigger ones score well. Few land in between. Yet the loss of those same models falls smoothly, with no bend at all.