4 ms·Ggml Q8 models on ollama can run on much cheaper hardware without losing much performance.by vinni2 2y agoGgml Q8 models on ollama can run on much cheaper hardware without losing much performance.