3 ms·

> running llamacpp with half the layers on the CPU and half the layers on the GPU How do you do that? Could you please provide a link if you have it handy.

• ynniv 3y ago
  When running you use "-ngl" to specify how many layers are uploaded to the GPU
• gsuuon 3y ago
  Just set the --gpu-layers|-ngl flag. Run main with --help to see all the options.