4 ms·
Phi-3 should be fixed as well - but yes there were bugs as well! https://x.com/danielhanchen/status/1782853167572832650 https://x.com/danielhanchen/status/17828
by danielhanchen 2y ago
Phi-3 should be fixed as well - but yes there were bugs as well! https://x.com/danielhanchen/status/1782853167572832650 https://x.com/danielhanchen/status/1782853167572832650
Phi-3's sliding window should be 2048 and not 2047, and they also had chat template issues - I uploaded correct versions to https://huggingface.co/unsloth/Phi-3.5-mini-instruct https://huggingface.co/unsloth/Phi-3.5-mini-instruct