2 ms·
Oh, boy. This good tool hates my LM Studio... The following message appears when I run Bonsai in my LM Studio. I think my settings have done something wrong. ``
by kent8192 6mo ago
Oh, boy.
This good tool hates my LM Studio...
The following message appears when I run Bonsai in my LM Studio.
I think my settings have done something wrong.
```
Failed to load the model
Error loading model.
(Exit code: null). Please check the settings and try loading the model again.
```
- liuliu 6mo agoIt needs a mlx fork because the lowest bit in mlx is 2 currently (for affine quantization).
- riidom 6mo agoThat mlx is for apple hardware only, though? Or did I misunderstand something.
- dragonwriter 6mo agoIt needs a llama.cpp fork, too; so the stock runtime (based on stock llama.cpp) used by LM Studio presumably won't work for it.
- dodos 6mo agoSame issue here, wanted to give it a shot but ran into that error trying to load the model in lm studio.