3 ms·
Tiny box is for running it at fp16, most other comments here talk about running it with 4bit quantization
by Tepix 3y ago
Tiny box is for running it at fp16, most other comments here talk about running it with 4bit quantization
loading thread…
3 ms·