3 ms·
Though it most probably does not run in on the 1070 but rather on the cpu. It cannot fit on a 1070, it is not about speed, a 1070 cannot run it period.
by dimask 3y ago
Though it most probably does not run in on the 1070 but rather on the cpu. It cannot fit on a 1070, it is not about speed, a 1070 cannot run it period.
- Dkuku 3y agoIn llama.cpp You can offload some of the layers to gpu with -ngl X. Where x is the number of layers