R3 · Open Problems
Running Out of Text
Estimate available high-quality data and evaluate the proposed escapes.
The public web holds something like 300 trillion tokens of good human text. One careful study says training runs will have used all of it somewhere between 2026 and 2032.