4 ms·
It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.
by skrblr 4y ago
It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.
- MuffinFlavored 4y agothe way these LLMs work, there is a weight for each parameter? 13 billion weights? what is an example of a parameter?
- dragonwriter 4y agoA parameter is a variable for which a weight (a floating point value) is the concrete value.
- kragen 4y agoa weight is an example of a parameter so is a bias, and presumably the biases are also in the same file with the weights