4 ms·
Because the code for that is nowhere near stable/usable unless you have the exact planetary alignment and/or blobs in your distro, and you invariably have to co
by rcarmo 2y ago
Because the code for that is nowhere near stable/usable unless you have the exact planetary alignment and/or blobs in your distro, and you invariably have to convert LLM weights. The number of LLMs supported is very, very small right now.
- Havoc 2y agoNPU yes. OpenCL support tends to be fine on most devices these days and has loads of weights available