2 ms·For an fp4 quantization it should fit with room to spare for KVCacheby _aavaa_ 4mo agoFor an fp4 quantization it should fit with room to spare for KVCacheTepix 4mo agoAren't Macbooks limited to 128GB RAM? FP4 would require >350GB RAM + KV cache, so no._aavaa_ 4mo agoOops, you’re right. My brain understood Mac Studio for some reason.