4 ms·
The quality with reformer is much much worse, it's not really comparable.
by Tenoke 4y ago
The quality with reformer is much much worse, it's not really comparable.
- bitL 4y agoYeah, but it fits on a single GPU. Now imagine it scaled across 1000 GPUs.
- Tenoke 4y agoI finetuned one in 2020[0] to play around with and the results still seemed a bit worse than a gpt of comparable size. 0. https://svilentodorov.xyz/blog/reformer-99m/ https://svilentodorov.xyz/blog/reformer-99m/