3 ms·
I don't think the integrated GPU on that supports CUDA. So you will need to use CPU mode only.
by rain1 3y ago
I don't think the integrated GPU on that supports CUDA. So you will need to use CPU mode only.
- itake 3y agoYep, but isn’t there an integrated ML chip that makes it faster than cpu? Or does llama.cpp not use that?
- rain1 3y agounfortunately that chip is proprietary and undocumented, it's very difficult for open source programs to make use of. I think there is some reverse engineering work being done but it's not complete.