2 ms·You can definitely go above 30B on consumer hardware – 2x gpus, spark, mac, half byte quants etc.by mirekrusin 4mo agoYou can definitely go above 30B on consumer hardware – 2x gpus, spark, mac, half byte quants etc.