R3 · Open Problems
Learning After Training
Explain catastrophic forgetting and why a permanent memory is still unsolved.
Tell a model something today and it will not know it tomorrow. The weights stopped moving when training ended. Everything since then lives in the prompt and is thrown away after.