3 ms·31B won't run in 48GB for me - it needs 54.by sgt101 4mo ago31B won't run in 48GB for me - it needs 54.yassa9 4mo agowhat quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enoughsgt101 4mo ago8bits is fine.... I was talking full bore.