It's enough for 6 bit quant with a somewhat restricted context length. Though based on the responses here, it needs sizable context to work, so we may be limit

It's enough for 6 bit quant with a somewhat restricted context length. Though based on the responses here, it needs sizable context to work, so we may be limited to 4 bit (I'm on an M3 Max w/ 48gb as well).