4 ms·
OK I am hosting the instruct model on the horde now. I will throw up the raw base model too: https://lite.koboldai.net/# https://lite.koboldai.net/# Note that
by brucethemoose2 3y ago
OK I am hosting the instruct model on the horde now. I will throw up the raw base model too:
https://lite.koboldai.net/# https://lite.koboldai.net/#
Note that you must switch to instruct mode in the UI, and use the "LLama 2 chat" preset, but you also need a <s> token in the instruction (memory) tab:
https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1#instruction-format https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1#in...