3 ms·
I would hazard a guess that they will release versions that will be a smaller size (they have in the past). But in order to run this, you'd just have to use a c
by robkop 6y ago
I would hazard a guess that they will release versions that will be a smaller size (they have in the past). But in order to run this, you'd just have to use a cloud provider, first guesses say it'll be 500GB+ of just weights that ideally you want in memory.
- ganstyles 6y agoEven the Teslas I use have 256GB memory and those are pretty cutting edge. 500GB in GPU memory is insane.
- whymauri 6y agoCould we bank on the Lottery Ticket Hypothesis, distillation, or other model compression algorithms to make these models smaller?
- aquajet 6y agoI would guess so, but compressing it by 1/3rd it's size (ie. distilgpt) would still be quite large. To be fair, I don't know if distillation scales like that.