3 ms·

What sort of hardware is needed to run either of these models in a usable fashion? I suppose the bigger 70B model is completely unusable for regular mortals...

• evanh1138 3y ago
  [dead]
• jinay 3y ago
  It's almost guaranteed that there will be quantizations and adaptations to consumer hardware that should make it both versions of the model accessible to mortals on consumer GPUs (and even CPUs).