4 ms·
As a human would you read 100GB of data all at once? Or would you read it bit by bit, taking notes and summarising as you went along. Then compiling your notes
by fennecbutt 3y ago
As a human would you read 100GB of data all at once?
Or would you read it bit by bit, taking notes and summarising as you went along. Then compiling your notes/summaries into a final report?
Because I don't see why we expect these models to be so superhuman when a 100K context would already be considered superhuman memory.
Imagine me regurgitating 100k tokens worth of dialogue at you and expecting you to take into account every thing I said. I know I couldn't do it, ha ha.
- throwup238 3y agoAs a human would you do tens of billions of multiplies and additions per second? Store tens of thousands of books on something the size of a finger nail and recall them with perfect fidelity every time? Communicate with another human via optical signals using thousand mile long optical fiber across the entire Pacific ocean? Eat electricity instead of food? Project images from your eyes? Can you stick an audio cable in your butt to power speakers? I'm talking about computers, not humans.
- fennecbutt 3y agoI mean I wouldn't put it past myself to try the audio cable in the butt trick, bet it'd feel great