3 ms·
Nice example! LLaVA's language model appears to be weaker than GPT-4's. And we've already seen the featured GPT-4 demo where it explains a visual gag with a m
by ekidd 4y ago
Nice example!
LLaVA's language model appears to be weaker than GPT-4's.
And we've already seen the featured GPT-4 demo where it explains a visual gag with a modified phone charging cable. So GPT 4 might get this.
On the other hand, this test is almost certainly in GPT 4's training set. And I've seen GPT 4 correctly answer questions that appear on only a half dozen pages on the entire web. And since the Obama scale test is from 2012, there's a decent chance GPT 4 might just remember the answer.
- famouswaffles 4y agoGpt-4 did pass it - https://twitter.com/karpathy/status/1635697741925064704 https://twitter.com/karpathy/status/1635697741925064704
- meghan_rain 4y agoit didnt, the twitter post is popular and thus surely inadverently part of the training set
- ljlolel 4y ago“Inadvertently”