2 ms·
There is also a gpu-acelerated fork of the original repo https://github.com/remixer-dec/llama-mps https://github.com/remixer-dec/llama-mps
by BoberMod 4y ago
There is also a gpu-acelerated fork of the original repo
https://github.com/remixer-dec/llama-mps https://github.com/remixer-dec/llama-mps
- xiphias2 4y ago> For 7B model, it always goes above 32gb of RAM, That's double of what Tinygrad uses
- DennisAleynikov 4y agoTinygrad is using openCL right?