The original dataset was 45 TB. The neural net model is condensed to 800 GB. https://www.springboard.com/blog/data-science/machine-learning-gpt-3-open-ai/ htt

The original dataset was 45 TB. The neural net model is condensed to 800 GB. https://www.springboard.com/blog/data-science/machine-learning-gpt-3-open-ai/ https://www.springboard.com/blog/data-science/machine-learni... Note that the "compression" there also includes the "intelligence" that it presents - you might be able to get some powerful compression of English text... but you can't ask a gzip file to come up with a joke about cats and dinosaurs.