3 ms·
It's almost guaranteed that there will be quantizations and adaptations to consumer hardware that should make it both versions of the model accessible to mortal
by jinay 2y ago
It's almost guaranteed that there will be quantizations and adaptations to consumer hardware that should make it both versions of the model accessible to mortals on consumer GPUs (and even CPUs).