D11 · Seeing and Hearing Together
Where They Fail
Spot a model that invents objects, grade it on a fair test, and name the note that fools a picture reader.
Researchers showed models photos and asked simple questions: is there a fork in this picture? Half the time there was none. In their hardest round, LLaVA said yes to 99 percent of the questions.