3 ms·
What's remarkable here is: 562 Billion parameters! Even with int8 it's 0.5TB of memory to run this
by rkwasny 4y ago
What's remarkable here is:
562 Billion parameters!
Even with int8 it's 0.5TB of memory to run this
- tucnak 4y agoAlso known as 500GB, or ~6.25 NVIDIA A100s so fits in a single cabinet.