3 ms·
Okay if anyone wants to try Llama 3.1 inference on CPU, try this: https://github.com/trholding/llama2.c https://github.com/trholding/llama2.c (L2E) It's a bit
by AMICABoard 2y ago
Okay if anyone wants to try Llama 3.1 inference on CPU, try this: https://github.com/trholding/llama2.c https://github.com/trholding/llama2.c (L2E)
It's a bit buggy but it is fun.
Disclaimer: I am the author of L2E