D6 · Sequences & Memory
A Character-Level Language Model
Train a tiny character model on this device and sample text from it.
A character model has one job: read the letters so far, and guess the next one. Nobody tells it that words exist. A space is just another symbol. Spelling, word breaks and agreement all come out of that one job, because getting them right is how you guess well.