4 ms·
I heard Ilya wasnt behind the big innnovations at OpenAI. It was lesser known scientists
by fdgsdfogijq 4y ago
I heard Ilya wasnt behind the big innnovations at OpenAI. It was lesser known scientists
- tempusalaria 4y agoOpenAI from a research point of view haven’t really had any “big innovations”. At least I struggle to think of any published research they have done that would qualify in that category. Probably they keep the good stuff for themselves But Ilya definitely had some big papers before and he is widely acknowledged as a top researcher in the field.
- fdgsdfogijq 4y agoI think the fact that there are no other systems publicly available that are comparable to GPT-4 (and I dont think Bard is as good), points to innovation they havent released
- bugglebeetle 4y agoPossibly. Or they could’ve also just paid a lot of people in Africa or wherever else to create the highest quality RLHF dataset out there.
- ragnarsson 4y agoThey mentioned in the Technical paper of GPT-4 that the capabilities of the model were not from RLHF. https://youtu.be/2zW33LfffPc?t=842 https://youtu.be/2zW33LfffPc?t=842