3 ms·
It's currently set not to stream (https://github.com/guywaldman/magic-cli/blob/4d4dca034063aa6433ebaadcbdb7cc192f55c05c/src/llm/ollama/ollama_llm.rs#L55C13-L55C
by guywald 2y ago
It's currently set not to stream (https://github.com/guywaldman/magic-cli/blob/4d4dca034063aa6433ebaadcbdb7cc192f55c05c/src/llm/ollama/ollama_llm.rs#L55C13-L55C19 https://github.com/guywaldman/magic-cli/blob/4d4dca034063aa6...).
The performance is something I plan to improve.