2 ms·

Are the cool kids using GGML?

• minimaxir 3y ago
  Also that.
  • hnfong 3y ago
    FWIW, the main developer of GGML apparently runs a M2 Ultra himself. Apple Silicon is a first class citizen on GGML and runs fast. See eg. https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running_ggufs_on_an_m1_ultra_is_an_interesting/ https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running...
• EVa5I7bHFq9mnYK 3y ago
  no, GGUF