4 ms·
Try to get motherboard based video output to handle your OS that way all the gpu ram is available. Can get a cheap 2nd gpu also if it fits in the case or open r
by instagib 3y ago
Try to get motherboard based video output to handle your OS that way all the gpu ram is available. Can get a cheap 2nd gpu also if it fits in the case or open rack setup you have in mind.
The exllamaV2 I run allows multiple gpu’s of different ram amounts.
- mejutoco 3y agoBooting in console mode saves some gpu form ubuntu graphical interface, in case you are almost able to run a model. It is hacky, but it might help someone.