D8 · Mechanistic Interpretability
What Counts as a Feature
Define a feature as a direction in activation space, not a neuron.
One layer of a network, on one input. Each square is one number it produced. We can print every number. We still cannot say what the layer is doing.