2 ms·
FWIW, the main developer of GGML apparently runs a M2 Ultra himself. Apple Silicon is a first class citizen on GGML and runs fast. See eg. https://www.reddit.c
by hnfong 3y ago
FWIW, the main developer of GGML apparently runs a M2 Ultra himself. Apple Silicon is a first class citizen on GGML and runs fast.
See eg. https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running_ggufs_on_an_m1_ultra_is_an_interesting/ https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running...