4 ms·
Phi-3 Weights Released
- homarp 3y agothey also released a version with 4k context , https://huggingface.co/microsoft/Phi-3-mini-4k-instruct https://huggingface.co/microsoft/Phi-3-mini-4k-instruct and official onnx and gguf (fp16 and Q4) versions
- deleted 3y ago[deleted]
- margorczynski 3y agoAre those numbers real in the technical report? If so it really is something big, a < 4 billion model overtaking SOTA 7-8 billion ones, and by quite a large margin. Seems too good to be true, or I'm missing something?
- unraveller 3y agoOthers are very sceptical it reaches llama3 8B level and claiming some mistakes in their benchmark numbers[1] of phi-2 at very least. they are updating fixes to the Phi-3 models on a few things very quickly so you will be able test soon but so far in my testing of 4k mini it has some properties that are better than even llama3 70b, namely admitting faults and correcting it once pointed out instead of hiding them again more creatively. Whatever inner intent balancing act it does seems more desirable to me for code things. [1] https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/discussions/20 https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/di...
- udev4096 3y agoAlso available on ollama: https://ollama.com/library/phi3 https://ollama.com/library/phi3
- homarp 3y agowell https://github.com/ggerganov/llama.cpp/issues/6849 https://github.com/ggerganov/llama.cpp/issues/6849 4k will work but "does not support long rope which is use by 128k variant."