4 ms·

Anyone know if this is supported in ik_llama.cpp?

• suprjami 3mo ago
  Just merged into main llama.cpp a few hours ago: https://github.com/ggml-org/llama.cpp/pull/25165 https://github.com/ggml-org/llama.cpp/pull/25165
• throwdbaaway 3mo ago
  It works, thanks to https://github.com/ikawrakow/ik_llama.cpp/pull/1911 https://github.com/ikawrakow/ik_llama.cpp/pull/1911, which got merged in early June. However, there might still be some issue with the chat template.
  • alfiedotwtf 3mo ago
    Awesome, thanks! Edit: it amazes me how fast ik_llama.cpp moves