D11 · Seeing and Hearing Together
Every Sense Becomes a Line
Say how a picture becomes a line of tokens, and count what it costs.
Send a chat model a photo of a menu and ask which dish is cheapest. It answers. Yet it never saw a picture. It read a line of tokens, the same kind of line it reads for words.