4 ms·
Since its trained from LLaMA-2 7B, you in theory can just straight up load the weights [1] with text-gen-ui or llama.cpp. Hoping TheBloke converts this to GGML
by syntaxing 3y ago
Since its trained from LLaMA-2 7B, you in theory can just straight up load the weights [1] with text-gen-ui or llama.cpp. Hoping TheBloke converts this to GGML + safetensors so I can try it out.
[1] https://huggingface.co/llSourcell/medllama2_7b/tree/main https://huggingface.co/llSourcell/medllama2_7b/tree/main