3 ms·
The magic "Just barely runs on 24GB VRAM" model being absent is fishy. Let's hope they do fix it and release it and this isn't a ploy to keep people in the clo
by dontupvoteme 3y ago
The magic "Just barely runs on 24GB VRAM" model being absent is fishy.
Let's hope they do fix it and release it and this isn't a ploy to keep people in the cloud by only releasing lesser models for local systems.
- brucethemoose2 3y agoYeah, purpose finetuned ~33B is a nice sweetspot. Its also just enough to split between CPU+dGPU on decent PCs.
- dontupvoteme 3y agoIn a way that may be the best local solution for some time. Swapping and/or merging finetunes.
- brucethemoose2 3y agoOr LORAs. This is how Stable Diffusion land operates.