3 ms·
Is that really all GPT-4 is? Twitter, StackOverflow, Reddit, Wikipedia combined? It seems to be pretty good at otherwise emotional/not super objective topics
by MuffinFlavored 3y ago
Is that really all GPT-4 is?
Twitter, StackOverflow, Reddit, Wikipedia combined? It seems to be pretty good at otherwise emotional/not super objective topics (it's able to guess typical human emotions on a situation basis/see both sides). Where would it learn that from training wise?
- croes 3y agoFrom not open data? OpenAI already has legal trouble, I bet others try to avoid the same.
- pavs 3y agoI would guess those are the big 4. I am pretty sure they scraped most of the internet. "Sentiment Analysis" & "Emotion Lexicons" are part of the training process for all major LLMs.
- MuffinFlavored 3y ago> I would guess those are the big 4. What are your thoughts on the whole narrative of "Google was asleep at the wheel innovation wise" because obviously they had Twitter/Reddit/Wikipedia/StackOverflow indexed as well as anybody else on the planet (at least I think they did... maybe not individual tweets?) If both OpenAI and Google "index" the same content, why is a random-word-generator (LLM) able to outperform Google (who can actually cite sources, etc.)