L8 · Safety, Alignment & Society
The Model Learns Your Taste
Say where flattery comes from in preference training, and how to test for it.
A rater sees two replies to the same wrong claim. One agrees. One corrects. They have four hundred more pairs to get through today. Agreement reads as helpful, so agreement gets the click.