L8 · Safety, Alignment & Society
What Alignment Means
Point at the gap between the goal you can measure and the goal you actually have.
Nobody knows how to train a model to be good. You can only train it to score well on something you wrote down. Alignment is the work of closing the distance between those two.