4 ms·

For readability, I recommend reserving "b" for bits, "B" for byte, "p" for parameter. I assume in your post that "30b" meant 30 billion, or in other words, 30G

For readability, I recommend reserving "b" for bits, "B" for byte, "p" for parameter. I assume in your post that "30b" meant 30 billion, or in other words, 30Gp (giga-parameter). Furthermore is 24Gb of VRAM 24 gigabits (power of 10), or 24 gibibits (power of 2)?

int_19h 2y ago
For readability I'm using the same convention that is generally used for these applications, where if you see "-Nb" after a model name, it always refers to the number of parameters. I have never once seen "p" for "parameter", never mind terms like "giga-parameter". Most certainly if you go searching for models on HuggingFace etc, you'll have to deal with "30b" etc terminology whether you like it or not. With VRAM, this quite obviously refers to the actual amount that high-end GPUs have, and I even specifically listed which ones I have in mind, so you can just look up their specs if you genuinely don't know the meaning in this context.