3 ms·
They effectively do. They’re trained by brute forcing 100TB of training data through them, rather than any logical learning technique. A human doesn’t need 100
by MagicMoonlight 8mo ago
They effectively do. They’re trained by brute forcing 100TB of training data through them, rather than any logical learning technique.
A human doesn’t need 100TB of books to learn the alphabet.
- rkomorn 8mo ago> A human doesn’t need 100TB of books to learn the alphabet. A human does need 16ish hours per day of audio/video content for several years to learn the alphabet.
- bayindirh 8mo agoI used a single letter stencil to learn the alphabet, actually, and nobody strapped me to a chair to watch or listen something 16h a day. Living inside a normal home with my parents was enough for the audio part.
- rkomorn 8mo agoThe 16 hours of audio/video per day was a reference to being alive and hearing/seeing things for years before you actually could learn the alphabet. It was not meant as literally sitting at a screen with audio/video for 16 hours a day.
- bayindirh 8mo agoI know, but the density of the data is much less in human case. IOW, humans still learn more effectively with less information, because there are innate mechanisms which process this data continuously and extract new meanings from the same data. This is part of both intelligence and consciousness. LLMs lack both.
- rkomorn 8mo ago> humans still learn more effectively with less information > because there are innate mechanisms which process this data continuously and extract new meanings from the same data To me, these statements strongly contradict each other, but I also really do not care enough to debate it.
- bayindirh 8mo agoI respect your disagreement and desire to leave the debate here. So we can agree to disagree. Have a nice day.
- __turbobrew__ 8mo ago> I know, but the density of the data is much less in human case. Is that really the case? How much data is it for 4k video, high bitrate auditory, spacial mapping, internal and external nervous system, emotions, and a dataset to correlate all of these in time?
- flobosg 8mo agoThen you meant audiovisual content.
- Betelbuddy 8mo ago[flagged]
- rkomorn 8mo agoI don't listen to Altman. Feel free to take this kind of comment somewhere else.