2 ms·
And now you need a server per model? Ollama loads models on-demand, and terminates them after idle, all accessible over the same HTTP API.
by yencabulator 2y ago
And now you need a server per model? Ollama loads models on-demand, and terminates them after idle, all accessible over the same HTTP API.