4 ms·Cool, what software?by modeless 1y agoCool, what software?asabla 1y agoInitial testing has only been done with ollama. Plan on testing out llama.cpp and vllm when there is enough time