3 ms·
You can use MLC with different (bigger) models, right?
by sroussey 4y ago
You can use MLC with different (bigger) models, right?
- execveat 4y agoYou can't right now. Devs are working on instructions for porting other models, but they're not ready yet. The point of MLC is that it supports pretty much all GPU backends out there (including Intel and Mac). The bundled model is just a proof of concept.