3 ms·
But it’s not just about compute. OpenAI did a lot of work to tame a wildcat. GTP-3 is a monster not fit for public consumption. ChatGTP is a kitten. Along the w
by dougmwne 4y ago
But it’s not just about compute. OpenAI did a lot of work to tame a wildcat. GTP-3 is a monster not fit for public consumption. ChatGTP is a kitten. Along the way OpenAI discovered that including code into the training corpus improves the general capabilities of LLMs. Google may have models with superior raw capability, but they do not have a safe and helpful product. They are clearly behind the ball and recent PR from Deepmind confirms they are feeling it.