The cost of hiring humans to write the trillions of tokens they trained from scratch would surely be much larger than the training cost. Except they avoided tha

The cost of hiring humans to write the trillions of tokens they trained from scratch would surely be much larger than the training cost. Except they avoided that cost by using what's available on the Internet. [1] Similarly, people are avoiding the cost of pre-training GPT-4 class model by scraping its output. So I think it's fair to question the moral consistency of their ToS. [1] Please note that I am not passing a judgement on this, just stating a fact in order to make an argument.