3 ms·
Is it possible to run the pretrained model on your own local hardware or is this really cloud only.
by joshmarinacci 3y ago
Is it possible to run the pretrained model on your own local hardware or is this really cloud only.
- brucethemoose2 3y agoYeah. Apparently GGML/GPTQ quantization works out of the box.