4 ms·
27B does, the op was talking about consumer use of DS v4 Flash, that's 160GB.
by lostmsu 4mo ago
27B does, the op was talking about consumer use of DS v4 Flash, that's 160GB.
- zozbot234 4mo agoIt has been quantized to 80GB (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model, and especially useful in a size range where few "native" models exist.
- lostmsu 4mo ago> (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model Uh-huh...