3 ms·

I am barely understanding, so a stupid question: Does this also mean that it would be possible to train on parallel GPU-poor setup instead of needing lots of G

by Geee 3y ago

I am barely understanding, so a stupid question: Does this also mean that it would be possible to train on parallel GPU-poor setup instead of needing lots of GPU memory / bandwidth on one computer?

dartos 3y ago
Probably not. The paper talks about this as an inference time optimization