A2 · Training Your Own Small Model
Letting the Giant Teach
Train a tiny model on a bigger model's beliefs instead of on human labels.
A model with thirteen numbers in it scored 91.7 on this inbox. It never saw a human label. A bigger model read six hundred messages and told it what it believed about each one.