D8 · Mechanistic Interpretability
The Neuron That Means Five Things
Recognize polysemantic neurons and say why they are the normal case.
Lesson 1 met a neuron that fired for cat faces and for car fronts. Was that one odd neuron? Or is that how most neurons work?