3 ms·
Will it be possible to run such model family in ollama?
by haddr 3y ago
Will it be possible to run such model family in ollama?
- andy99 3y agoMamba is supported in llama.cpp so should be (edit - apparently it's not strictly the mamba architecture, it's a mix of mamba and transformers, so it looks like it would have to be ported to llama.cpp)