2 ms·
Well it's not a completely meaningless metric as it immediately tells you roughly how much memory you need to load it, which is kind of important?
by moffkalast 3y ago
Well it's not a completely meaningless metric as it immediately tells you roughly how much memory you need to load it, which is kind of important?
- mjburgess 3y agoIf you look at my suggestion, it's to state exactly that memory -- rather than to estimate based on bits/parameter.
- moffkalast 3y agoWell then do explain a bit further, I still don't fully grasp what "100s PT in 0.5T" means exactly. 100 petatokens in half a trillion? Half a terrabyte? 100 seconds? Plus afaik base model training tokens don't have the same effect as fine tuning tokens, so there would need to be a way to specify each of those separately.