2 ms·
Of course. Models don't actually require VRAM. Nor do they require regular RAM. You could have 1 GB of RAM and swap the model to disk as you need different part
by charcircuit 2mo ago
Of course. Models don't actually require VRAM. Nor do they require regular RAM. You could have 1 GB of RAM and swap the model to disk as you need different parts of it. And if you didn't have enough disks you could access weights via a network connection.
- leoooodias 2mo agoYou don’t even need electricity. You could print the model weights onto millions of sheets of paper, and hire a team of carrier pigeons to fly them into your office one by one. No VRAM!
- revolvingthrow 2mo agoThe bitrot would be excessive
- BonerWiener 2mo agoIP over Avian Carriers: https://www.rfc-editor.org/info/rfc2549/ https://www.rfc-editor.org/info/rfc2549/
- chuckadams 2mo agoCoincidentally that’s also Google’s new method for distributing Android sources.
- kQq9oHeAz6wLLS 2mo agoThe key to running in lower amounts of VRAM is patience. It'll be slow, but it'll work.