Depends on what you want to do. For writing and RPG style interactions some of the LLama 2 based models are pretty good. Beauty is, even the 13B models work in

Depends on what you want to do. For writing and RPG style interactions some of the LLama 2 based models are pretty good. Beauty is, even the 13B models work in those cases. So it works reasonably well on consumer grade hardware.