SSDs don’t wear from reading, only from writing. Assuming a sensible, somewhat linear layout using mmap to map the weights would give you the ability to load a

SSDs don’t wear from reading, only from writing. Assuming a sensible, somewhat linear layout using mmap to map the weights would give you the ability to load a lot in memory, with potentially a fairly minimal page-in overhead