3 ms·
GPT Neo 1.3B (https://huggingface.co/EleutherAI/gpt-neo-1.3B https://huggingface.co/EleutherAI/gpt-neo-1.3B) is the largest I can run on my 12Gb VRAM GPU, and I
by gigel82 4y ago
GPT Neo 1.3B (https://huggingface.co/EleutherAI/gpt-neo-1.3B https://huggingface.co/EleutherAI/gpt-neo-1.3B) is the largest I can run on my 12Gb VRAM GPU, and I'm sorry to say it's output is a joke (nowhere near GPT-3, more like GPT-2 level of BS).
However, you can fine tune it; and I'm sure with lots of fine tuning and some jiggling of the parameters you can get a half decent custom-purpose solution.