3 ms·
I'm now waiting for a macOS local-run app that does ChatGPT like StableDiffusion became an app after 14 days and now runs on my laptop (as DiffusionBee).
by janandonly 4y ago
I'm now waiting for a macOS local-run app that does ChatGPT like StableDiffusion became an app after 14 days and now runs on my laptop (as DiffusionBee).
- mk_stjames 4y agoThe difference is there was a lot of work done with the multiple networks S.D. uses to make them fit into <8GB of GPU memory before they released it. In this case, and the # of parameters for this level of GPT is in the hundreds of GB (I think I read an estimate about ~340GB) meaning that there isn't a single consumer GPU that can even load the model. You need a rack of A100's even to do any inference.