3 ms·
Besides the official docs you can check out llama.cpp as an example that uses metal for accelerated inference on Apple silicon.
by feznyng 2y ago
Besides the official docs you can check out llama.cpp as an example that uses metal for accelerated inference on Apple silicon.