4 ms·
Llama2 13b runs on an m1 at 13 tokens/s. So they will be able to do this on an iPhone. https://gist.github.com/gengwg/26592c1979a0bca8b65e2f819e31ab5c https://
by acchow 3y ago
Llama2 13b runs on an m1 at 13 tokens/s. So they will be able to do this on an iPhone.
https://gist.github.com/gengwg/26592c1979a0bca8b65e2f819e31ab5c https://gist.github.com/gengwg/26592c1979a0bca8b65e2f819e31a...
- deleted 3y ago[deleted]