3 ms·
Probably a machine with about 628 GB of GPU memory. (2 bytes per parameter) So 8xH100 (80Gb each) should do it.
by 317070 3y ago
Probably a machine with about 628 GB of GPU memory. (2 bytes per parameter)
So 8xH100 (80Gb each) should do it.
- Marlinski 3y agoI suppose it can be quantizised