2 ms·

What nonsense is this? Where do you imagine ggml is from? > The llama.cpp project is the main playground for developing new features for the ggml library ->

What nonsense is this? Where do you imagine ggml is from? > The llama.cpp project is the main playground for developing new features for the ggml library -> https://github.com/ollama/ollama/tree/27da2cddc514208f4e23539e00485b880e3e2191/ml/backend/ggml/ggml https://github.com/ollama/ollama/tree/27da2cddc514208f4e2353... (Hint: If you think they only write go in ollama, look at the commit history of that folder)

nolist_policy 1y ago
llama.cpp clearly does not support iSWA: https://github.com/ggml-org/llama.cpp/issues/12637 https://github.com/ggml-org/llama.cpp/issues/12637 Ollama does, please try it.
imtringued 1y ago
Dude, they literally announced that they stopped using llama.cpp and are now using ggml directly. Whatever gotcha you think there is, exists only in your head.
- noodletheworld 1y ago
  I'm responding to this assertion: > Ollama is written in golang so of course they can not meaningfully contribute that back to llama.cpp. llama.cpp consumes GGML. ollama consumes GGML. If they contribute upstream changes, they are contributing to llama.cpp. The assertions that they: a) only write golang b) cannot upstream changes Are both, categorically, false. You can argue what 'meaningfully' means if you like. You can also believe whatever you like. However, both (a) and (b), are false. It is not a matter of dispute. > Whatever gotcha you think there is, exists only in your head. There is no 'gotcha'. You're projecting. My only point is that any claim that they are somehow not able to contribute upstream changes only indicates a lack of desire or competence, not a lack of the technical capacity to do so.
  - refulgentis 1y ago
    FWIW I don't know why you're being downvoted other than a standard from the bleachers "idk what's going on but this guy seems more negative!" -- cheers -- "a [specious argument that shades rather than illuminates] can travel halfway around the world before..."

nolist_policy 1y ago

llama.cpp clearly does not support iSWA: https://github.com/ggml-org/llama.cpp/issues/12637 https://github.com/ggml-org/llama.cpp/issues/12637 Ollama does, please try it.

imtringued 1y ago

Dude, they literally announced that they stopped using llama.cpp and are now using ggml directly. Whatever gotcha you think there is, exists only in your head.

noodletheworld 1y ago
I'm responding to this assertion: > Ollama is written in golang so of course they can not meaningfully contribute that back to llama.cpp. llama.cpp consumes GGML. ollama consumes GGML. If they contribute upstream changes, they are contributing to llama.cpp. The assertions that they: a) only write golang b) cannot upstream changes Are both, categorically, false. You can argue what 'meaningfully' means if you like. You can also believe whatever you like. However, both (a) and (b), are false. It is not a matter of dispute. > Whatever gotcha you think there is, exists only in your head. There is no 'gotcha'. You're projecting. My only point is that any claim that they are somehow not able to contribute upstream changes only indicates a lack of desire or competence, not a lack of the technical capacity to do so.
- refulgentis 1y ago
  FWIW I don't know why you're being downvoted other than a standard from the bleachers "idk what's going on but this guy seems more negative!" -- cheers -- "a [specious argument that shades rather than illuminates] can travel halfway around the world before..."