3 ms·
> Our experiments across four LLMs and two MLLMs demonstrate Gemini's competitive commonsense reasoning capabilities. I couldn't glean from the post; does anyo
by andsoitis 3y ago
> Our experiments across four LLMs and two MLLMs demonstrate Gemini's competitive commonsense reasoning capabilities.
I couldn't glean from the post; does anyone know what the test suite is?
I notice failure in common sense reasoning quite often in Bard and ChatGPT and while I haven't done a systematic analysis of the categories of mistakes, some patterns I've seen include: lack of self-reflection, not noticing internal inconsistency in output, lack of awareness of what would be "common" common sense, etc.