I'm not quite sure what you mean here - English Wikipedia is ~60GB, and there are definitely models trained on Wikipedia that are less than 60GB (eg: Llama 7B),

I'm not quite sure what you mean here - English Wikipedia is ~60GB, and there are definitely models trained on Wikipedia that are less than 60GB (eg: Llama 7B), but that's a lossy store of information - you won't get perfect recital of a Wikipedia page from an LLM