20 ms·
Extend your VRAM using RAM, then extend your RAM using Swap.
by Insanity 7mo ago
Extend your VRAM using RAM, then extend your RAM using Swap.
- SV_BubbleTime 7mo agoIf you are doing video models, this is an excellent way to murder your SSD. Do not put swap on an SSD you care about at all.
- Insanity 7mo agoI was writing it somewhat tongue-in-cheek and not as a serious suggestion. But thanks for adding the disclaimer, that's good advice!
- rvz 7mo ago> Do not put swap on an SSD you care about at all. This. Many people rediscovering what the purpose of swap files are, but will still find a way to abuse it without knowing that they are actually destroying their SSD.
- zozbot234 7mo agoYou can of course monitor SMART wearout indicators to check whether this is happening. Casual use of swap for non LLM-use is actually fine since "cold" ephemeral data will be swapped out first and that will never get written to; KV cache is mostly fine since it's similarly append-only so writes are tolerably small; but yes, more general LLM inference totally breaks that limited-writes pattern and will wear out/kill your media.
- duskdozer 7mo agozram swap otoh should be relatively 'free'
- zozbot234 7mo agoLLM working memory is not compressible so ZRAM doesn't buy you anything.
- system2 7mo agoAnd burn the swap pagesys file to a rewritable DVD to complete the cycle. It will be super fast that way.
- krige 7mo agoExtend your RAM using RAM Doubler!
- FooBarWidget 7mo agoThen extend your disk space using DoubleSpace/DriveSpace!
- Datagenerator 7mo agoJust to be sure install Stacker (from STAC electronics) too
- lossyalgo 7mo agoI did that. It worked, until it didn't, and then I learned how to format my 340MB HDD and re-install DOS 6.22. Fun times!
- lokimoon 7mo ago[dead]