L5 · Talking to Models
Why Models Make Things Up
Explain where a confident false answer comes from and what actually reduces it.
Every candidate is scored on how well it fits the document so far. Nothing in that score is a check against the world. A false answer that reads well scores well. That is the whole of it.