3 ms·
All this needless difficulty when you can just do the right thing and use oogabooga. https://github.com/oobabooga/text-generation-webui https://github.com/ooba
by Der_Einzige 3y ago
All this needless difficulty when you can just do the right thing and use oogabooga.
https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
- simonw 3y agoLooks like that provides an OpenAI-compatible API endpoint, which means you can use my LLM command-line utility against with the same pattern as for Llamafile: https://simonwillison.net/2023/Dec/18/mistral/#llamafile-openai https://simonwillison.net/2023/Dec/18/mistral/#llamafile-ope...