3 ms·

4-bit StableLM and 2-bit 7B models do seem to be working more consistently.

• brittlewis12 3y ago
  That’s great to hear. I’m sorry again about that poor experience, and please do reach out if you have any other feedback! Britt