4 ms·
Also available on ollama: https://ollama.com/library/phi3 https://ollama.com/library/phi3
by udev4096 3y ago
Also available on ollama: https://ollama.com/library/phi3 https://ollama.com/library/phi3
- homarp 3y agowell https://github.com/ggerganov/llama.cpp/issues/6849 https://github.com/ggerganov/llama.cpp/issues/6849 4k will work but "does not support long rope which is use by 128k variant."