3 ms·
Thanks for your suggestion! I think it was just the filename. I tried the model you suggested by opening it in LLMStudio and keep getting 8.3 tps.
by pantulis 1y ago
Thanks for your suggestion!
I think it was just the filename. I tried the model you suggested by opening it in LLMStudio and keep getting 8.3 tps.
- pantulis 1y agoNow this is raising my curiosity, is there anything else I could try and tweak to achieve better tps? Can it be related to being GGUF instead of MLX?