3 ms·
It works. I use ollama these days, with litellm for the api compatibility, and it seems to use both 24GB GPUs on the server.
by speedgoose 3y ago
It works. I use ollama these days, with litellm for the api compatibility, and it seems to use both 24GB GPUs on the server.