4 ms·
Let's say I wanted to use one of their quantized models with this OpenLLM project. How would I do that?
by PcChip 3y ago
Let's say I wanted to use one of their quantized models with this OpenLLM project. How would I do that?
- Aerroon 3y agoSorry, I don't know. I suspect that it's not possible (yet?). OpenLLM lists a bunch of models in the Github Readme. I think the best way would be to use those for now.