4 ms·
Sure, but compared to the 3080 I'd say that the main deal is the bigger RAM for copying reason than the increased core count.
by Jhsto 6y ago
Sure, but compared to the 3080 I'd say that the main deal is the bigger RAM for copying reason than the increased core count.
- option 6y agoTIP: if you need to emulate a bigger batch with less RAM available - use gradient accumulation trick. Super easy to implement in Pytorch and it is already implemented as a single flag (accumulate_grad_batches) in Pytorch Lightning.
- p1esk 6y agoYour gradient accumulation trick involves multiple cpu to gpu transfers, which is precisely what the parent is trying to avoid with fitting a larger batch in gpu memory.