L3 · The Transformer
The Residual Stream
Describe the stack as layers reading from and writing to one shared stream.
Stop picturing a pipeline where each layer hands its work to the next. Picture one long vector per token, running from the embedding to the output. Every layer reads a copy and adds a note back. Nobody erases. The top is the embedding plus every note.