3 ms·
If GPT-4 has 10 terabytes (10^13) of stored memories, how long are the sentences it has stored if there are 100 (10^2) different words to choose from? Wouldn't
by fl7305 3y ago
If GPT-4 has 10 terabytes (10^13) of stored memories, how long are the sentences it has stored if there are 100 (10^2) different words to choose from?
Wouldn't that be a table of sentences less than 7 words long?
100^7 = (10^2)^7 = 10^14