3 ms·
One person on Reddit claimed the first unsloth release was buggy - if you used that, maybe you can retry with the fixed version?
by manmal 1y ago
One person on Reddit claimed the first unsloth release was buggy - if you used that, maybe you can retry with the fixed version?
- hobofan 1y agoI think this was only regarding the chat template that was provided in the metadata (this was also broken in the official release). However, I doubt that this would impact this test, as most inference frameworks will just error if provided with a broken template.
- daemonologist 1y agoIt was - Unsloth put up a message on their HF for a while to only use the Q6 and larger. I'm not sure to what extent this affected prediction accuracy though.