2 ms·
> with an older GPU none of the LLMs will run for me since I don’t have enough VRAM. I think you can run Pygmalion 6B on a 8GB GPU using DeepSpeed. It's very
by cypress66 4y ago
> with an older GPU none of the LLMs will run for me since I don’t have enough VRAM.
I think you can run Pygmalion 6B on a 8GB GPU using DeepSpeed.
It's very underwhelming if you expect something like ChatGPT though.