L8 · Safety, Alignment & Society
Misuse, Accidents and Uplift
Sort a risk into misuse, accident or structure, and price a control against it.
An accident is a system doing what nobody wanted. Misuse is a person getting exactly what they wanted. Structure is neither: the technology shifts who has power or work, and no single person decided it. Each needs a different fix, so mixing them up leads to the wrong one.