My Kagi-fu says "Be like water, my friend. The size of the data is not important, only the quality. OpenAI curated/filtered 45TB of data to extract those 570GB.

My Kagi-fu says "Be like water, my friend. The size of the data is not important, only the quality. OpenAI curated/filtered 45TB of data to extract those 570GB. Much of the text that we encounter in this world is like the empty chatter of a bird, mere noise that serves no purpose".