3 ms·
They’ve already been trained on orders of magnitude more text than a human being ever sees or hears in their entire life, without approaching human intelligence
by joshuahedlund 4y ago
They’ve already been trained on orders of magnitude more text than a human being ever sees or hears in their entire life, without approaching human intelligence. What text is left to train them on?
- fiso64 4y agoNext up is training multimodal models on audio and video. Humans may see less text, but they still train on more data in total.
- naasking 4y ago> They’ve already been trained on orders of magnitude more text than a human being ever sees or hears in their entire life, without approaching human intelligence Actually ChatGPT has an IQ of ~83, so that is quite close to average human intelligence. Furthermore, it was trained only on digital text, arguably that would be it's only "sensory organ". It had no other senses with which to correlate terms and concepts it inferred from text, and look how amazing it is just from that. As the other poster said, multimodal training is the next step and people are not going to be prepared for it.
- tspike 4y agoHow much visual, auditory, and sensory data have they been trained on? What "pain" have they experienced? There are a lot of input vectors that haven't been factored in yet, and a lot of external integration points that haven't been explored.