3 ms·
Commercialization of large machine learning models might push the RAM game for the end user up in the not-too-far future. For unified memory machines like the c
by w-m 4y ago
Commercialization of large machine learning models might push the RAM game for the end user up in the not-too-far future. For unified memory machines like the current Apple chips that is, and otherwise the memory on consumer GPUs for the enthusiasts.
Last week, several posts made it to the HN front page of stable diffusion forks that reduce the memory usage, to make it possible to generate 512x512 images with < 10 GB GPU memory, but with a tradeoff in computing speed. Trying to go beyond HD resolution (far from phone photo resolution) will still blow out your top-of-the-line Nvidia consumer GPU.
When approaches like these will be hitting your favorite image editing tool, you'll want to get that 256 GB RAM iPad for your mom. Otherwise, you'll have to deal with her having to wait minutes to give your family cat a festive hat in last year's Christmas picture.