A2 · Training Your Own Small Model
Three Ways to Fix It
Pick between more labels, weight decay and stopping early by reading what each one buys.
The last lesson's model memorized forty messages. The usual cures are ten times the labels, a pull on the weights, or stopping early. They cost different amounts, and they fix different things.