4 ms·
Check out the LLaMA memory requirements on Apple Silicon GPU here: https://github.com/remixer-dec/llama-mps https://github.com/remixer-dec/llama-mps
by anentropic 4y ago
Check out the LLaMA memory requirements on Apple Silicon GPU here: https://github.com/remixer-dec/llama-mps https://github.com/remixer-dec/llama-mps