4 ms·
It's not disk swap. It's multi-devices LLM.
by _ache_ 2y ago
It's not disk swap. It's multi-devices LLM.
- kridsdale3 2y agoThat looked like an analogy. Back in the days of a mechanical arm moving magnetic fields around in our PCs, you could have the illusion of infinite RAM as long as you're ok with microsecond operations now taking two million times longer. This is akin.
- wpietri 2y agoI think the point is that it has the same sort of latency tradeoff that disk swap did: it's awful, but sometimes better than nothing.