3 ms·
And with GPU just do this for the first command docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama You'll need to
by politelemon 3y ago
And with GPU just do this for the first command
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
You'll need to have the NVidia container toolkit installed.
- alexchantavy 3y agoThank you! For docker-compose, do deploy: resources: reservations: devices: - driver: nvidia count: 1 capabilities: [gpu] Docs: https://docs.docker.com/compose/gpu-support/ https://docs.docker.com/compose/gpu-support/