A2 · Training Your Own Small Model
Shrinking It to Ship
Round a model's weights onto a coarse ladder and find the point where the score starts to pay.
This model is 1,796 bytes. Round each weight to eight bits and it is 449, with the same score. Four times smaller, for free. The question is how far down you can go.