8 ms·
Wait what? Glue as in extract high level semantic representations from _syntatic probabilities_ and pass on to appropriate domain specific tools? This is the g
by enord 4y ago
Wait what? Glue as in extract high level semantic representations from _syntatic probabilities_ and pass on to appropriate domain specific tools?
This is the glaring hole in LLMs, a paradoxical semantic incoherence despite impressive sentenial and gramatical coherence.
As glue it is so thin as to be potable.
- ricopags 4y agoQuoting this tweet[0]: "Here's a brief glimpse of our INCREDIBLE near future. GPT-3 armed with a Python interpreter can · do exact math · make API requests · answer in unprecedented ways" [0]https://twitter.com/sergeykarayev/status/1569377881440276481 https://twitter.com/sergeykarayev/status/1569377881440276481
- enord 4y agoAll that remains is a small matter of programming…
- sharemywin 4y agoLanguage Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents https://wenlong.page/language-planner/ https://wenlong.page/language-planner/
- sharemywin 4y agoyou would still need an executive it would be more like a universal translator.
- enord 4y agoTranslate to what? The next likely string of characters? How would this executive even interact with it? Sibling comment of yours mentioned extracting low level steps from high level tasks but it needed another language model (no kidding!) to map to the «most likely» of the admissable actions. I mean, this shit is half baked even in theory.