Fair point, my Zephyrus G14 4090 64+16GB has the same issues, it can run smaller LLaMA2 models much faster than 128GB M3 Max (3x) but 70B one is much slower due

Fair point, my Zephyrus G14 4090 64+16GB has the same issues, it can run smaller LLaMA2 models much faster than 128GB M3 Max (3x) but 70B one is much slower due to CPU doing half of the layers (10x). So in the end I ended up with both.