3 ms·
The practical question of interest is: will this make it possible to run GPT-3 size models on normal desktops with GPU? Like Stable Diffusion.
by visarga 4y ago
The practical question of interest is: will this make it possible to run GPT-3 size models on normal desktops with GPU? Like Stable Diffusion.
- SoftTalker 4y agoAt some point the practical question would be how do you get all the data onto the desktop.
- Dylan16807 4y agoPeople are already downloading 100GB games. And data rates are growing much faster than RAM capacities. The logistics of downloading a model smaller than GPU RAM are unlikely to ever get complicated.
- nine_k 4y agoUsing bittorrent, of course :) Once AI models become usable on desktops without esoteric hardware, their datasets will go the way of all large media which people have been distributing for many years.