4 ms·
Wow, didn't this happen with Intel? I think that was a noticeable drop in performance. This is probably worse given people were trying to experiment with local
by resource_waste 3y ago
Wow, didn't this happen with Intel? I think that was a noticeable drop in performance.
This is probably worse given people were trying to experiment with local LLMs on CPU. Its not like they even offer Nvidia.
- breckenedge 3y agoMacs have GPUs and their architecture means that GPU has access to the full system RAM. Cuda isn’t a requirement for running ML workloads on a GPU.