3 ms·
From what I can tell, all the GPT team did was scale up ideas already there invented elsewhere in previous large language models. I am not sure that is a reaso
by fromMars 2y ago
From what I can tell, all the GPT team did was scale up ideas already there invented elsewhere in previous large language models.
I am not sure that is a reason to bet on them making any breakthroughs needed for AGI.
- gizmo 2y agoOpenAI also pioneered reinforcement learning from human feedback (RLHF) to make LLMs output completions that are valuable/relevant. I agree that OpenAI has provided no evidence they are anywhere close to AGI (and I don't think LLMs are sufficient) but also I think OpenAI should get a ton of credit for being the first party to make LLMs that actually useful.