4 ms·
https://www.reddit.com/r/PygmalionAI/ https://www.reddit.com/r/PygmalionAI/ is one. Mainly people are using it as an alternative to http://character.ai http://
by narrator 4y ago
https://www.reddit.com/r/PygmalionAI/ https://www.reddit.com/r/PygmalionAI/ is one. Mainly people are using it as an alternative to http://character.ai http://character.ai which people have said used to be incredible but has been slowly degrading in quality as it has grown more popular. The 6B parameter model, which is the only one that is even worth running according to many users, only runs on cards with 16gb of vram or Google Colab Cloud Service and people say it's not as good as character.ai.
There are other huge models like Bloom that are more general purpose, but they require greater than 24GB of ram which means multiple linked GPUs to even run them much less train them.
Thus, unlike stable diffusion, chatbots that run on common consumer GPUs are going to need some work to be competitive with commercial offerings.