3 ms·
You could technically dynamically offload the RAM overload to disk but this would probably be too slow?
by The_rationalist 5y ago
You could technically dynamically offload the RAM overload to disk but this would probably be too slow?
- whimsicalism 5y agoI mean, theoretically if you can get the model weights onto disk then you should be able to do the computation - but it might takes days or months on commodity hardware. It would also require creating a system that can do this and I doubt there is much demand.