3 ms·
I bought one for this purpose, but LM Studio doesn't seem to want to run even the most quantized versions. Any suggestions?
by adastra22 11mo ago
I bought one for this purpose, but LM Studio doesn't seem to want to run even the most quantized versions. Any suggestions?
- FuckButtons 11mo agoAre you using the mix quantized versions? Also, there’s a setting that disables the memory allocation guardrails they put in place, which are irrelevant since macOS handles oom quite gracefully.