rogerdox14

3 ms·

1. 1.▲
   by rogerdox14 2y ago

   Or you could run it quantized on about $6k worth of 192GB Mac Studio — probably not that fast.
2. 2.▲
   by rogerdox14 2y ago

   Various Internet sources claim Rashida Jones sounds a lot like Scarlett Johansson: could Rashida Jones have voiced ‘Sky’?
3. 3.▲
   by rogerdox14 3y ago

   "recommended max working set size" is a property of the Mac the model is being run on, not the model itself. The model is smaller than that, otherwise it wouldn't be running on GPU.