3 ms·
Wasn't Phi-3 also bugged/is still bugged? Seems like Microsoft just doesn't care. >to be on par with GPT-4o mini Phi is known to overfit benchmarks. It's way,
by sunaookami 2y ago
Wasn't Phi-3 also bugged/is still bugged? Seems like Microsoft just doesn't care.
>to be on par with GPT-4o mini
Phi is known to overfit benchmarks. It's way, way worse then that.
- throwaway314155 2y agoAnecdotally, I've been experimenting with Phi-4 the past hour or so (so, yeah, not very comprehensive) and it's certainly a strong model. Definitely better than the previous Phi models.
- danielhanchen 2y agoYep Phi-4 definitely is better than Phi-3.5!
- danielhanchen 2y agoPhi-3 should be fixed as well - but yes there were bugs as well! https://x.com/danielhanchen/status/1782853167572832650 https://x.com/danielhanchen/status/1782853167572832650 Phi-3's sliding window should be 2048 and not 2047, and they also had chat template issues - I uploaded correct versions to https://huggingface.co/unsloth/Phi-3.5-mini-instruct https://huggingface.co/unsloth/Phi-3.5-mini-instruct