3 ms·
If you are doing video models, this is an excellent way to murder your SSD. Do not put swap on an SSD you care about at all.
by SV_BubbleTime 7mo ago
If you are doing video models, this is an excellent way to murder your SSD.
Do not put swap on an SSD you care about at all.
- Insanity 7mo agoI was writing it somewhat tongue-in-cheek and not as a serious suggestion. But thanks for adding the disclaimer, that's good advice!
- rvz 7mo ago> Do not put swap on an SSD you care about at all. This. Many people rediscovering what the purpose of swap files are, but will still find a way to abuse it without knowing that they are actually destroying their SSD.
- zozbot234 7mo agoYou can of course monitor SMART wearout indicators to check whether this is happening. Casual use of swap for non LLM-use is actually fine since "cold" ephemeral data will be swapped out first and that will never get written to; KV cache is mostly fine since it's similarly append-only so writes are tolerably small; but yes, more general LLM inference totally breaks that limited-writes pattern and will wear out/kill your media.
- duskdozer 7mo agozram swap otoh should be relatively 'free'
- zozbot234 7mo agoLLM working memory is not compressible so ZRAM doesn't buy you anything.