R3 · Open Problems
Where Does Scaling Stop?
Lay out the strongest case for and against scaling continuing to work.
Give a language model ten times more compute, and the part of its error that can shrink falls by only about a tenth. This lesson asks what that costs, and whether a floor waits underneath.