3 ms·
Because Twitter, StackOverflow, Reddit etc. stopped the access to their data.
by croes 3y ago
Because Twitter, StackOverflow, Reddit etc. stopped the access to their data.
- hobs 3y agoYou can still download Stack Overflow anytime https://archive.org/download/stackexchange https://archive.org/download/stackexchange
- rpastuszak 3y agoIt doesn't seem up to date.
- hobs 3y agoIt's not, but what percentage of new questions has come into that dataset since then?
- MuffinFlavored 3y agoIs that really all GPT-4 is? Twitter, StackOverflow, Reddit, Wikipedia combined? It seems to be pretty good at otherwise emotional/not super objective topics (it's able to guess typical human emotions on a situation basis/see both sides). Where would it learn that from training wise?
- croes 3y agoFrom not open data? OpenAI already has legal trouble, I bet others try to avoid the same.
- pavs 3y agoI would guess those are the big 4. I am pretty sure they scraped most of the internet. "Sentiment Analysis" & "Emotion Lexicons" are part of the training process for all major LLMs.
- MuffinFlavored 3y ago> I would guess those are the big 4. What are your thoughts on the whole narrative of "Google was asleep at the wheel innovation wise" because obviously they had Twitter/Reddit/Wikipedia/StackOverflow indexed as well as anybody else on the planet (at least I think they did... maybe not individual tweets?) If both OpenAI and Google "index" the same content, why is a random-word-generator (LLM) able to outperform Google (who can actually cite sources, etc.)