5 ms·

This is doing inference on the CPU, right?

• mchiang 3y ago
  On the mac, we have enabled Metal support.
  • jpeeler 3y ago
    What is the best way to confirm that the GPU is being utilized? I can open Activity Monitor and see the usage spike, but surely there's a better/direct way.
    • Traveler42 3y ago
      Try asitop. For me it doesn't indicate anything but CPU is in use. https://github.com/tlkh/asitop https://github.com/tlkh/asitop