3 ms·

How? What kind of data? You think you can just hook up a firehose of visual or auditory data to ChatGPT and have that produce anything meaningful? That's not

How? What kind of data? You think you can just hook up a firehose of visual or auditory data to ChatGPT and have that produce anything meaningful? That's not even the basic format that ChatGPT operates in. Furthermore, isn't part of the point of the dataset an LLM is trained on that it has to be at least moderately structured and tagged, or you end up with garbage in the output?

flangola7 3y ago
Meta has an LLM trained on multiple senses, including images, sound, video, physical motion, heat, and lidar depth.
gmerc 3y ago
Yes. There’s multiple companies working on exactly that. Nothing stops you from preprocessing the data and augmenting it which is my entire point.