4 ms·
That story says: > Estimates for GPT4, for example, give training data sizes of up to 1 petabyte of data. I followed the provided link, which lead to an ad-la
by simonw 2y ago
That story says:
> Estimates for GPT4, for example, give training data sizes of up to 1 petabyte of data.
I followed the provided link, which lead to an ad-laden https://seifeur.com/chat-gpt-4-data-size/ https://seifeur.com/chat-gpt-4-data-size/ article which looks suspiciously like AI-generated slop. It ends with this set of Q&As which make no sense at all:
> How much data was used to train ChatGPT-4?
> ChatGPT-4 was trained on a dataset size of 570 GB.
> How does the size of GPT-4 compare to GPT-3 in terms of training data?
> GPT-4 has 45 gigabytes of training data, which is significantly larger than GPT-3’s 17 gigabytes.
> How many terabytes of text data does GPT-4 utilize compared to GPT-3?
> GPT-4 utilizes a dataset of 1 petabyte, which is notably larger than GPT-3’s 45 terabytes.
- peab 2y agothat's one of the first 10 links that show up on google when you search for "gpt4 training size". If it is AI generated slop, that's unfortunate. I probably didn't spend enough time looking for sources for the size of GPT4's training data. But to my defense, I have ad block on, so I did not know that link was ad ridden.