4 ms·
Errr 20M is a few hours to train 10K iters on 8x V100s for what I’ve been doing. 300M is in the range of 4-8 nodes of that scale.
by buildbot 3y ago
Errr 20M is a few hours to train 10K iters on 8x V100s for what I’ve been doing. 300M is in the range of 4-8 nodes of that scale.
- quickthrower2 3y agoI'll check my wandb account when I can to see what I got (it was months ago). At the moment I can't log in "An application error occurred. Click to refresh the page." :-o I was using a 3090 though - I remember that because I was using vast.ai and a cheapskate! That card has serious bang for buck.
- quickthrower2 3y agoJust a thought: Are people confusing million and billion?
- buildbot 3y agoOr the library I’ve been using for this work is … not very memory efficient possibly? I’ve been referring to millions at least intentionally