3 ms·
Can this model run on ollama?
Can this model run on ollama?
https://huggingface.co/QuantFactory/AMD-Llama-135m-GGUF https://huggingface.co/QuantFactory/AMD-Llama-135m-GGUF
I tried the Q_8, but it was all over the place, so not really trained for instruction and chat yet, I think :)