It would potentially be slower because pcie bandwidth is likely to be lower than memory bandwidth. The way to get a speed up is to split the load across both t

It would potentially be slower because pcie bandwidth is likely to be lower than memory bandwidth. The way to get a speed up is to split the load across both the CPU and GPU since LLMs can be split into layers. This also increases the size the model can be.