3 ms·
most implementations do, like https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui this might be a hallucinate
by underlines 4y ago
most implementations do, like https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
this might be a hallucinated answer, due to the very small model size of 7b. try the 13b-4bit, it's much better!