3 ms·
Justine knows this and it is stated right there on the page: > The first time you load a model after rebooting your computer, it's still going to go slow, beca
by saurik 4y ago
Justine knows this and it is stated right there on the page:
> The first time you load a model after rebooting your computer, it's still going to go slow, because it has to load the weights from disk. However each time it's loaded afterwards, it should be fast (at least until memory pressure causes your file cache to be evicted).
- Zuiii 4y agoIs the initial load via mmap slower than the non mmap approach? If it is, why is it slower?