3 ms·
Also that.
by minimaxir 3y ago
Also that.
- hnfong 3y agoFWIW, the main developer of GGML apparently runs a M2 Ultra himself. Apple Silicon is a first class citizen on GGML and runs fast. See eg. https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running_ggufs_on_an_m1_ultra_is_an_interesting/ https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running...