16 ms·
Do you need to use Mixtral? The typical quantized Mistral 7B and similar models can do summarization fine.
by minimaxir 3y ago
Do you need to use Mixtral? The typical quantized Mistral 7B and similar models can do summarization fine.
- ithkuil 3y agoI'm using gpt-4 as an assistant for basic computing questions such helping with quick shell one liners or looking up for the simplest way to do some manipulation of rust values (vec of result into result of vec which I always forget how to do etc). I wanted to try how local models compare with that use case of mine. The only one that worked decently was Mixtral
- yawnxyz 3y agoHaha no not at all, but it’s fun!