4 ms·It is much faster on single prompts than ollama. 3X is not unheard ofby Der_Einzige 2y agoIt is much faster on single prompts than ollama. 3X is not unheard of