4 ms·
Not the GP, but I believe that they are talking about the size of the training data set in relation to the model size.
by gmueckl 3y ago
Not the GP, but I believe that they are talking about the size of the training data set in relation to the model size.
- mirekrusin 3y agoYou don't need to and can't really load all training data. For LLMs you need to load single row of context size, that's vector of ie. 8k numbers, which is 32kB for single precision floats.