2 ms·
We generally only hallucinate while dreaming / using our imagination. And we can distinguish those two states. Admitting lack of knowledge is of course good but
by vlovich123 4y ago
We generally only hallucinate while dreaming / using our imagination. And we can distinguish those two states. Admitting lack of knowledge is of course good but, for example, if you ask it to write some code that isn’t boilerplate API integrations, it’ll do so happily even when it’s wildly wrong and it can’t tell the difference and that is also the case with GPT4 afaik. Moreover, you can’t solve it through prompt engineering because there’s clearly a lack of context it’s unable to understand to figure out what non trivial thing your asking it.
- vidarh 4y agoThe point is there's been progress in making it admit when it doesn't know, and we simply don't know how fast that will improve in future version. It may continue to be an issue, or turn out to be easily solved. The improvement with GPT4 does suggest it is at least possible to make it recognise its limits.
- senko 4y agoThere is ongoing promising work that shows this can be improved a lot: https://arxiv.org/abs/2210.03629 https://arxiv.org/abs/2210.03629