3 ms·
The idea of using VRAM as general-purpose storage has been around for over a decade, although it usually makes more sense to put swap on it: https://forums.gen
by userbinator 4y ago
The idea of using VRAM as general-purpose storage has been around for over a decade, although it usually makes more sense to put swap on it:
https://forums.gentoo.org/viewtopic-t-395234-start-0.html https://forums.gentoo.org/viewtopic-t-395234-start-0.html
https://www.pmenier.net/dotclear/docext/mtd/TIP_Use_memory_on_video_card_as_swap.html https://www.pmenier.net/dotclear/docext/mtd/TIP_Use_memory_o...
- jwilk 4y agoOver two decades, as you pointed out in https://news.ycombinator.com/item?id=11559869 https://news.ycombinator.com/item?id=11559869.
- userbinator 4y ago...and that was almost 7 years ago too, during which my second link there also died; but that was before the rise of all the AI stuff and its accompanying demand for GPUs with otherwise insane amounts of VRAM.
- gruturo 4y agoMake that three decades ago. In 1992 I was using a utility called VGADISK to create a 176K ramdisk in the VGA memory - this was on a 286 "laptop" (rather a luggable) with 1MB of RAM, and allowed me to fit entire programs in there as long as they didn't use VGA graphics (which would instantly corrupt the content of the ramdrive). Still online thanks to http://www.retroarchive.org/garbo/pc/memutil/index.html http://www.retroarchive.org/garbo/pc/memutil/index.html - a whopping 8KB zip archive, so about 30 seconds on my 2400bps modem (assuming V42 or MNP4)
- mobilio 4y agoOr this one https://wiki.archlinux.org/title/Swap_on_video_RAM https://wiki.archlinux.org/title/Swap_on_video_RAM
- Rediscover 4y agoOMG! I run in either text mode or very minimal graphics mode. This is a very appreciated comment. Now I am going to reconfigure my home machines to steal back that otherwise unused VRAM for swap. Thank You!!
- slug 4y agoIs this safe ? Had the impression that undetected bit-flips were more common with GPU RAM than with CPU RAM banks, unless you have professional GPU cards with ECC.
- speed_spread 4y agoI guess you could have software error correction and still be faster than swap to flash?
- voxadam 4y agoVRAM RAID!
- chronogram 4y agoWhy would you add a dedicated graphics card to computers that run in text mode or a very minimal graphics mode? Seems expensive.
- 2III7 4y agoFor non-graphical computing tasks that require a GPU.
- LoveMortuus 4y ago+extra ports for monitors
- Rediscover 4y agoI did not add a card, that is the way the machine is shipped/manufactured. SBC.
- actionfromafar 4y agoI used I think 32 megabytes VRAM as swap way back when. I think it was on single channel AGP or PCI bus, so it wasn't fast, but much faster than disk, so pretty good.
- FooBarWidget 4y agoIn the era of huge ML models, wouldn't it make more sense to do the opposite, i.e. use main RAM or SSD as swap voor VRAM? So that we can run e.g. ChatGPT on consumer hardware.
- rbanffy 4y agoA lot of low-end GPUs do that and, when you don't have enough memory to fit the working dataset in the GPU's very fast RAM, the CPU will end up swapping in and out of the GPU via the PCIe bus.
- brucethemoose2 4y agoThis is easier said than done, though certain frameworks (like Microsoft's Deepspeed) try to do this "automatically"
- dahart 4y agoI don’t know about Linux these days, but Windows WDDM likes to have host-backed storage for VRAM allocations... which makes me wonder if using VRAM for swap could ever get you into a weird recursive state with allocations or swapping. It’s already the case that allocating VRAM on Windows can require waiting on swapping some VRAM to disk. What if that swap had to then go back to VRAM?