4 ms·
Unironically, yes. Detailed, nuanced, human level modeling of the world provides an interface with automation that allows for complex tasks and workflows to be
by observationist 2y ago
Unironically, yes. Detailed, nuanced, human level modeling of the world provides an interface with automation that allows for complex tasks and workflows to be built and trusted. "Go clean up the kitchen" might involve something where the question of "is this trash, or is this an adorable drawing made by a child that should be saved" or other such collisions between seemingly clear instructions and the vast context baked into the world requiring interpretation at a more-or-less human level. The system could even frame the above decision as "get clarification, or risk being thrown in the trash."
One of the huge advances in the last 5 years has been categorization of images, alongside segmentation, in conjunction with reasoning about categories. LLM chatbots and generative images and audios are the simplest and least nuanced uses of transformers, with the least friction between training and deployment of a product. Generative models tend to allow perception as detailed, varied, and nuanced as their output produces, and integration of these software capabilities will happen in new and surprising ways for many years to come.
TLDR; what they can create, they can see - advanced image models enable advanced computer vision.
- n4r9 2y agoThanks for the response; I see your point that housework can have pretty significant cognitive requirements. I'm not sure I understood sufficiently the argument for why LLMs are well-placed to attack that sort of categorisation, but it's something for me to mull over.