2 ms·
3090 or 4090 will be able to run quantized 22B models. Though realistically for code completion smaller models will be better due to speed
by Havoc 2y ago
3090 or 4090 will be able to run quantized 22B models.
Though realistically for code completion smaller models will be better due to speed