4 ms·
Link to report please
by outofpaper 3y ago
Link to report please
- lhl 3y agohttps://www.reddit.com/r/Oobabooga/comments/126dejd/comment/jebvlt0/?utm_source=reddit&utm_medium=web2x&context=3 https://www.reddit.com/r/Oobabooga/comments/126dejd/comment/...
- kiratp 3y agoYou can do it on CPU now. Benchmarks: https://github.com/ggerganov/llama.cpp/issues/34 https://github.com/ggerganov/llama.cpp/issues/34