3 ms·
No they did not. They tested GPT-2. GPT-2 is the version that gave us those classic AI Dungeon games that were absolutely hilarious because the model was so dum
by ilaksh 3y ago
No they did not. They tested GPT-2. GPT-2 is the version that gave us those classic AI Dungeon games that were absolutely hilarious because the model was so dumb that it couldn't follow from one end of a sentence to another.
I think that there are lots of cognitive abilities and characteristics that are missing from LLMs or could have better approaches. But looking at the performance of GPT-2 doesn't "deal a blow" to anything remotely near leading edge.
- kridsdale3 3y agoHow has the transformer architecture changed from GPT2,3,4?
- ilaksh 3y agoIt doesn't prove anything about the capabilities of any model other than the one tested. It's not just the most basic aspect of the architecture. The model weights determine the capabilities to a large degree.