3 ms·I have yet to get any useful output out of the Q5_K_S version; haven't tried any others yet.by aidenn0 3y agoI have yet to get any useful output out of the Q5_K_S version; haven't tried any others yet.daakus 3y agoI used mistral-7b-v0.1.Q5_K_M.gguf and it responded to basic questions.poser-boy 3y agoLinked is the base model. What you want is the instruct model (also on TheBloke's profile), which has been trained on following instructions.