D5 · Seeing
Reusing a Trained Model
Reuse a pretrained vision model on a small task, and choose what to freeze.
In 2014 a group at KTH in Stockholm tried something lazy. They took a network trained on ImageNet and kept the numbers it computed just before its answer. A plain linear classifier on those numbers beat carefully tuned systems on new tasks. Their title called it an astounding baseline.