L10 · Smaller, Faster, Cheaper
Who Gets the Answer
Work out whether a model fits a device from its weights and its bits, and name the four ways to shrink it.
A model with seven billion weights, stored the way it was trained, fills 14 gigabytes. Suppose a phone lets one app use 4 of its gigabytes. That model does not fit, and nobody on that phone gets its answers.