A2 · Training Your Own Small Model
LoRA, by Picture
Adapt a frozen model by training two skinny matrices instead of a whole layer.
There is a way to adapt a model without touching a single one of its weights. You leave them frozen and train 44 new numbers beside them. Switch those off and the old model is back, exactly.