31 ms·
“What’s the memory bandwidth (GB/s) of the device holding the model weights?” Isn’t the recommended option going to be dog slow at 256 GB/s.
by bluechair 5mo ago
“What’s the memory bandwidth (GB/s) of the device holding the model weights?”
Isn’t the recommended option going to be dog slow at 256 GB/s.