L4 · Training a Language Model
From Predictor to Assistant
Say what supervised fine-tuning changes, and what it leaves exactly as it was.
Ask a freshly pretrained model a question and it often writes you more questions. It is not being difficult. On the web, a question is often followed by another question.