5 ms·
Will Doubling Disk Size Solve Storage?
by ansk 4y ago
Will Doubling Disk Size Solve Storage?
- visarga 4y agoThe practical question of interest is: will this make it possible to run GPT-3 size models on normal desktops with GPU? Like Stable Diffusion.
- SoftTalker 4y agoAt some point the practical question would be how do you get all the data onto the desktop.
- Dylan16807 4y agoPeople are already downloading 100GB games. And data rates are growing much faster than RAM capacities. The logistics of downloading a model smaller than GPU RAM are unlikely to ever get complicated.
- nine_k 4y agoUsing bittorrent, of course :) Once AI models become usable on desktops without esoteric hardware, their datasets will go the way of all large media which people have been distributing for many years.
- wolfram74 4y agoI feel like the fastest tier of ram can only get so big before speed of light delays become relevant.
- brrrrrm 4y agoStorage isn’t much of an issue these days. The bottleneck is computing values from RAM, fp8 can improve this drastically