3 ms·
ChatGPT doesn't give you the full vocabulary probability distribution, while locally running does. You need the full probability distribution to do things like
by Der_Einzige 4y ago
ChatGPT doesn't give you the full vocabulary probability distribution, while locally running does. You need the full probability distribution to do things like constrained text generation, e.g. like this: https://paperswithcode.com/paper/most-language-models-can-be-poets-too-an-ai https://paperswithcode.com/paper/most-language-models-can-be...