3 ms·
I'm claiming that the max amount of intelligence you get out of a 100GB model is unlikely to be that much lower than what you can get out of a 1TB model.
by fooker 3mo ago
I'm claiming that the max amount of intelligence you get out of a 100GB model is unlikely to be that much lower than what you can get out of a 1TB model.
- xyzsparetimexyz 3mo agoThat depends on whether you can separate intelligence from memorization. I think we can agree that theres more than 1 TB of memorizable information in the world, even when highly compressed.
- fooker 3mo agoSure, agreed. The question then is, how much memorization is really needed for intelligence if you can query structured information?