3 ms·
And trainable on only 96 GPUs? Loving this recent trend in vision models that are borderline tractable to replicate.
by heyitsguay 4y ago
And trainable on only 96 GPUs? Loving this recent trend in vision models that are borderline tractable to replicate.
- two_in_one 4y agoThis is a progress. ;) If I'm not mistaken biggest LLaMA used 2000 GPUs for 21 day.
- polygamous_bat 4y agoEven the biggest vision models have traditionally been much smaller than even medium-sized "large" language models, so I don't think the comparison is purely apple to apple.
- runningStone 4y agoif meta win, Nvidia win^2