> 13 hours to generate one sentence This is hysterical, they're literally swapping from VRAM to RAM and certainly to disk as well since a 70B GGUF is at least

> 13 hours to generate one sentence This is hysterical, they're literally swapping from VRAM to RAM and certainly to disk as well since a 70B GGUF is at least 30-40 GB in total. I suppose it's slightly better than not being able to to it at all, but jesus christ this is just hilariously bad.