3 ms·
Great to see Meta back, looks like really strong, local model, can't wait for llama.cpp support.
by mirekrusin 2mo ago
Great to see Meta back, looks like really strong, local model, can't wait for llama.cpp support.
- jakswa 2mo agosome support already merged, and I verified in a local build that it runs (cannot get MTP params working tho, about ~40 tok/s on my beefy 800GB/s 7900XT w/ 20GB VRAM). https://github.com/ggml-org/llama.cpp/pull/26841 https://github.com/ggml-org/llama.cpp/pull/26841
- bwfan123 2mo agoJust tested muse-glimmer:30b-mlx on my laptop. Works great although a bit slow.