3 ms·
A float16 is 2 bytes. 7B * 2 bytes = 14GB. I can't say if that's an accurate number, but that's almost certainly how tonii141 calculated it.
by a_t48 1y ago
A float16 is 2 bytes. 7B * 2 bytes = 14GB. I can't say if that's an accurate number, but that's almost certainly how tonii141 calculated it.
- sfphoton 1y agoOh, so FP16 means FloatingPoint16? I'm glad to learn something today, thanks!