4 ms·

True, I might be thinking of some of the communities four-Spark clusters for it; it’s already int4 right?

• Tepix 5mo ago
  Yeah, the default quants are 595GB. Even four Sparks would require a quant lower than 4bit