2 ms·
Isn't there a problem with the Falcon models being too slow? At least I have seen reports of the quantised model being very slow [1] https://huggingface.co/Th
by kristianp 3y ago
Isn't there a problem with the Falcon models being too slow? At least I have seen reports of the quantised model being very slow [1]
https://huggingface.co/TheBloke/WizardLM-Uncensored-Falcon-40B-GPTQ https://huggingface.co/TheBloke/WizardLM-Uncensored-Falcon-4...