4 ms·
ChatGPT is fine tuned on a curated, relatively small dataset, which is of very high value and would mitigate some of the attacks
by jerpint 4y ago
ChatGPT is fine tuned on a curated, relatively small dataset, which is of very high value and would mitigate some of the attacks
- alchemist1e9 4y agoHave you come across any specific details on their input datasets? I’ve been assuming CommonCrawl and Pile but if you have anything specific it would be very interesting what else was used.
- sbierwagen 4y agoAll the major LLM vendors are vague on datasets because it's quite certainly copyrighted text, (Remember when Google was scanning all the world's books a decade ago?) and they don't want to give the inevitable lawsuits a jump start.
- amelius 4y agoYou can just ask ChatGPT what data it was trained on. > The news groups' concerns arose when the computational journalist Francesco Marconi posted a tweet last week saying their work was being used to train ChatGPT. Marconi said he asked the chatbot for a list of news sources it was trained on and received a response naming 20 outlets including the WSJ, New York Times, Bloomberg, Associated Press, Reuters, CNN and TechCrunch. https://www.bloomberg.com/news/articles/2023-02-17/openai-is-faulted-by-media-for-using-articles-to-train-chatgpt https://www.bloomberg.com/news/articles/2023-02-17/openai-is...
- sebzim4500 4y ago>Remember when Google was scanning all the world's books a decade ago? Yes, and I remember that they won that lawsuit.
- hiddencost 4y agohttps://www.google.com/amp/s/blog.google/products/search/overview-our-rater-guidelines-search/amp/ https://www.google.com/amp/s/blog.google/products/search/ove...
- Timon3 4y agoThis works fine for now. I am however worried that politics will make this much harder in the future. We're already seeing that a certain crowd wishes that AI responses reflect the "average" without any kinds of filtering. If they were to pass a law in this direction (and, let's face it, considering all the other overstepping laws passed in the direction of book banning etc. this is sure to come) we might not have any choice or options left.