3 ms·
Wouldn't that much VRAM just be needed for training the model? Not inference?
by syspec 5y ago
Wouldn't that much VRAM just be needed for training the model? Not inference?
- calum-bird 5y agoHaha I wish! That's just loading the weights for inference :)
- syspec 5y agoI sense a humblebrag
- calum-bird 5y agoHaha indeed, NLP is fun!