4 ms·
This is a hard question for language models since it targets one of their known weaknesses.
by tmnvdb 2y ago
This is a hard question for language models since it targets one of their known weaknesses.
- layer8 2y agoUsers don’t care about how hard something is for LLMs if they receive incorrect output.
- andyg_blog 2y agoGreek mythology? But seriously please elaborate for my less educated self.
- tmnvdb 2y agoLLMs often don't do well on tasks that require composition into smaller subtasks. In this case there is a chain of relations that depend on the previous result.
- _bin_ 2y agoit tests syllogistic reasoning: Jason's mother was Tyro, whose father was Poesidon, whose father was Kronos. it also tests whether it "eagerly" rather than comprehensively considers something: a maternal great-grandfather could be the father of either one's maternal grandmother or maternal grandfather. so the answer could also be king Aeolus of the Etruscans. ideally a model would be able to answer this accurately and completely.
- nimithryn 2y agoI think there are more possible answers? Jason's mother differs depending on the author... For example, Jason's mother was Philonis, daughter of Mestra, daughter of Daedalion, son of Hesporos. So Jason's maternal great-grandfather was Hesporos.
- 11101010001100 2y agoIt's categorically more than a weakness.