A3 · Shipping and Operating AI
Two Phases and a Cache
Name the two phases of an answer and work out how much conversation one card can hold.
Your rewrite is not the only answer on that chip. While the server writes for you, it is writing for forty other people, and it has to remember every one of them.