3 ms·
Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...
by redman25 2y ago
Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...
- blebo 2y agoDepends on quantization selected - see https://www.canirunthisllm.net/ https://www.canirunthisllm.net/