2 ms·
Yeah, purpose finetuned ~33B is a nice sweetspot. Its also just enough to split between CPU+dGPU on decent PCs.
by brucethemoose2 3y ago
Yeah, purpose finetuned ~33B is a nice sweetspot.
Its also just enough to split between CPU+dGPU on decent PCs.
- dontupvoteme 3y agoIn a way that may be the best local solution for some time. Swapping and/or merging finetunes.
- brucethemoose2 3y agoOr LORAs. This is how Stable Diffusion land operates.