> The great thing about gguf is that it will cross to system RAM if there isn't enough VRAM. Then you can just run it entirely on CPU. There is no point to buy

> The great thing about gguf is that it will cross to system RAM if there isn't enough VRAM. Then you can just run it entirely on CPU. There is no point to buy an expensive GPU to run LLMs to be bottlenecked by your CPU in the first place. Which is why I do not get so excited with these huge models, as they gain less traction as not as many people can run them locally, and finetuning is probably more costly too.