3 ms·
The likely architecture of GPT-4 was invented at Google - MoE. OpenAI poached the team who developed it. OpenAI is ahead on the RL data side. To me that’s the
by tempusalaria 3y ago
The likely architecture of GPT-4 was invented at Google - MoE. OpenAI poached the team who developed it.
OpenAI is ahead on the RL data side. To me that’s the likely biggest advantage they have in GPT-4.
- danenania 3y agoWouldn’t Google be able to catch up easily if that was really OpenAI’s only advantage? Google has a lot more resources to throw at RL. It seems like there must be some other secret sauce for OpenAI to continue maintaining such a huge lead.