3 ms·
No because multi-modal learning is next. A human can learn what a rock is after N=1 only because we have the visual/tactile of the rock (combined with our intui
by hackerlight 4y ago
No because multi-modal learning is next. A human can learn what a rock is after N=1 only because we have the visual/tactile of the rock (combined with our intuitive understanding physics etc) to go with the text label. We can immediately guess how it fits into our world from that visual/tactile. GPT needs very large N to grasp the concept of a rock because it requires a lot of textual associations to figure that concept out.
- astrange 4y agoIt is next conceptually, but it’s not proven you can do it till someone’s done it. Other rumors suggest whatever GPT4 is, it’s not multimodal. I don’t believe large models are great multimodal demonstrations either, insofar as being large just lets you memorize different modalities side by side without necessarily integrating them.