M3 Max 128GB RAM inference on LLaMA2 70B is much faster than on Zephyrus G14 64GB with 4090/16GB because one can fit the whole model into the RAM and share it w

M3 Max 128GB RAM inference on LLaMA2 70B is much faster than on Zephyrus G14 64GB with 4090/16GB because one can fit the whole model into the RAM and share it with GPU. For smaller models that can fit into 16GB G14 smokes M3 Max.