L10 · Smaller, Faster, Cheaper
Choosing With a Measured Eval
Pick the cheapest setting that meets a bar set in advance, measured in every language your users speak.
On English questions, the 4-bit model scores one point under the full one. On Arabic questions, the same model falls four and a half. Measure only English and you would ship it.