3 ms·
Does anyone know if GPU passthrough is available in any kind of macOS guests? I was hoping to run fast LLM inference in containers or virt guests.
by cjbprime 3y ago
Does anyone know if GPU passthrough is available in any kind of macOS guests? I was hoping to run fast LLM inference in containers or virt guests.
- fkorotkov 3y agoThere is a paravirtualized GPU available to macOS hosts. But it’s a bit limited and might not work for LLMs but worth trying since it might work.