4 ms·Llama.cpp has --n-gpu-layers that lets you set how much of the model to put on the GPU.by sp332 3y agoLlama.cpp has --n-gpu-layers that lets you set how much of the model to put on the GPU.