4 ms·
How has the transformer architecture changed from GPT2,3,4?
by kridsdale3 3y ago
How has the transformer architecture changed from GPT2,3,4?
- ilaksh 3y agoIt doesn't prove anything about the capabilities of any model other than the one tested. It's not just the most basic aspect of the architecture. The model weights determine the capabilities to a large degree.