3 ms·
Isn't gpt like 800gb big? I can compress a 1gb file to 0 bytes if i am allowed 1gb of additional data.
by bawolff 3y ago
Isn't gpt like 800gb big? I can compress a 1gb file to 0 bytes if i am allowed 1gb of additional data.
- ChadNauseam 3y agoYou can't if you have to pick the 1gb of additional data before you see the 1gb file you're supposed to compress (which is the situation gpt is in)
- bawolff 3y agoAlthough in this case, we know the data comes from wikipedia and i assume gpt was trained on wikipedia, so it really does seem unfair.