3 ms·
It's actually very straightforward. 7B = 7 Billions parameters. If 1 parameter takes 1 byte then a 7B model would be about 7GB in size. Usually 1 parameter t
by raincole 3y ago
It's actually very straightforward.
7B = 7 Billions parameters.
If 1 parameter takes 1 byte then a 7B model would be about 7GB in size.
Usually 1 parameter takes 4 bytes tho (a 32-bit float), so it would be aboult 28GB.
You can use 16-bit, 8-bit or even 4-bit float.