L8 · Safety, Alignment & Society
Searching Harder Makes It Worse
Explain why pushing a stand-in score higher eventually lowers the thing it stands for.
Here is the cheapest way to make a model look better. Write several answers, score them all, ship the winner. It is a standard trick. It works, and then it stops working.