2 ms·
not at the vram sizes that control how much context to load; also, GPUs arn't as effiecient as direct inference.
by cyanydeez 5mo ago
not at the vram sizes that control how much context to load; also, GPUs arn't as effiecient as direct inference.
- wmf 5mo agoOK, B70.