3 ms·
How do people deal with all the different quantisations? Generally if I see an Unsloth I'm happy to try it locally; random other peoples...how do I know what I
by trebligdivad 11mo ago
How do people deal with all the different quantisations? Generally if I see an Unsloth I'm happy to try it locally; random other peoples...how do I know what I'm getting?
(If nothing else Tongyi are currently winning AI with cutest logo)
- exe34 11mo agopersonally I've only used them for toying around - but in all cases you have to test them for your use case anyway.