3 ms·
Yeah, but it fits on a single GPU. Now imagine it scaled across 1000 GPUs.
by bitL 4y ago
Yeah, but it fits on a single GPU. Now imagine it scaled across 1000 GPUs.
- Tenoke 4y agoI finetuned one in 2020[0] to play around with and the results still seemed a bit worse than a gpt of comparable size. 0. https://svilentodorov.xyz/blog/reformer-99m/ https://svilentodorov.xyz/blog/reformer-99m/