3 ms·
I see no evidence of that, transformers seem to follow the same trend as other architectures with improved models coming out every month that demonstrate simila
by ad404b8a372f2b9 4y ago
I see no evidence of that, transformers seem to follow the same trend as other architectures with improved models coming out every month that demonstrate similar performance with orders of magnitude less parameters.
- nerdponx 4y agoI think by "effective" they meant better overall performance, not necessarily better performance per parameter or hour of training.