3 ms·
In my interactions with GPT-4 recently, it often says that it is unsure or doesn’t know. I got access yesterday to its image-interpretation function. Below are
by tkgally 3y ago
In my interactions with GPT-4 recently, it often says that it is unsure or doesn’t know. I got access yesterday to its image-interpretation function. Below are some results in which it expresses uncertainty about what appears in a photograph.
https://www.gally.net/temp/20231015gpt4hedging/index.html https://www.gally.net/temp/20231015gpt4hedging/index.html
The only confabulations are when reading text. In my tests so far, GPT-4 is not a good OCR engine and does make up a lot.
- wizofaus 3y agoWow, it can't even recognise obviously Japanese characters?
- tkgally 3y agoNo. I also tested GPT-4 with a photo containing some very clear kanji and hiragana, and it misidentified every single character. For English text it worked okay with a contemporary document, but when I tried a 17th century text it hallucinated a lot of the words. Conventional character-by-character OCR is much more reliable. The samples I posted above don’t contain any major hallucinations about nontext image components, but other tests I’ve done with GPT-4 did. But GPT-4’s image recognition still seems better than Bard’s, which has been pretty bad in the tests I’ve done with it.
- eurekin 3y agoI wouldn't be surprised if system token included "this photo contains following text: <output of tesseract ocr here>"