3 ms·
The real gold standard is https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui Which includes the llama.cpp ba
by Der_Einzige 3y ago
The real gold standard is https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
Which includes the llama.cpp backend, and a lot more.
Unfortunately, despite claiming to be the "Automatic1111" of text generation, it doesn't support any of the prompt engineering capabilities (i.e. negative prompts, prompt weights, prompt blending, etc) available in Automatic1111, despite the fact that it's not difficult to implement - https://gist.github.com/Hellisotherpeople/45c619ee22aac6865ca4bb328eb58faf https://gist.github.com/Hellisotherpeople/45c619ee22aac6865c...
Luckily for Ooga Booga, no one else supports it either. Why this is? I have no explanation except that the NLP community doesn't know jack about prompt engineering, which is Kafkaesque