4 ms·
Maybe lots of the data is embedding values or tokenizer stuff, where a single prompt uses a fraction of those values. And then the rest of the model is quite sm
by matsemann 4y ago
Maybe lots of the data is embedding values or tokenizer stuff, where a single prompt uses a fraction of those values. And then the rest of the model is quite small.
- w1nk 4y agoThat shouldn't be the case. 30B is a number that directly represents the size of the model, not the size of the other components.