4 ms·
My understanding is the ChatGPT basically swallowed up the entire internet, although it was a snapshot that might be out of date now. Of course accuracy and cor
by tus666 3y ago
My understanding is the ChatGPT basically swallowed up the entire internet, although it was a snapshot that might be out of date now. Of course accuracy and correctness are concerns, but that would apply to any kind of summarizer service, and even primary sources can be wrong. Extensive research would always be required to get near 100% confidence of correctness.
- verdverm 3y agoIt only had part of the internet, OpenAI is nowhere near as comprehensive at web scraping as Google, I don't think they actually scraped at all for this, using existing data like CommonCrawl. The other thing you are not understanding is that it did not memorized these things, it built representations for predicting the most likely next token. This is why it hallucinates and makes up numbers and web links or citations that do not exist.