5 ms·
Have you come across any specific details on their input datasets? I’ve been assuming CommonCrawl and Pile but if you have anything specific it would be very in
by alchemist1e9 4y ago
Have you come across any specific details on their input datasets? I’ve been assuming CommonCrawl and Pile but if you have anything specific it would be very interesting what else was used.
- sbierwagen 4y agoAll the major LLM vendors are vague on datasets because it's quite certainly copyrighted text, (Remember when Google was scanning all the world's books a decade ago?) and they don't want to give the inevitable lawsuits a jump start.
- amelius 4y agoYou can just ask ChatGPT what data it was trained on. > The news groups' concerns arose when the computational journalist Francesco Marconi posted a tweet last week saying their work was being used to train ChatGPT. Marconi said he asked the chatbot for a list of news sources it was trained on and received a response naming 20 outlets including the WSJ, New York Times, Bloomberg, Associated Press, Reuters, CNN and TechCrunch. https://www.bloomberg.com/news/articles/2023-02-17/openai-is-faulted-by-media-for-using-articles-to-train-chatgpt https://www.bloomberg.com/news/articles/2023-02-17/openai-is...
- sebzim4500 4y ago>Remember when Google was scanning all the world's books a decade ago? Yes, and I remember that they won that lawsuit.
- hiddencost 4y agohttps://www.google.com/amp/s/blog.google/products/search/overview-our-rater-guidelines-search/amp/ https://www.google.com/amp/s/blog.google/products/search/ove...