3 ms·Is 48GB enough to run 70B models ?by moonchrome 3y agoIs 48GB enough to run 70B models ?sacred_numbers 3y agoYes, with 4 bit quantization.