2 ms·
MLC[0] indicates that it can run models in the 8B range on iOS, but 1-3B sounds more reasonable to me. [0] https://llm.mlc.ai/docs/deploy/ios.html#bring-your-o
by SparkyMcUnicorn 1y ago
MLC[0] indicates that it can run models in the 8B range on iOS, but 1-3B sounds more reasonable to me.
[0] https://llm.mlc.ai/docs/deploy/ios.html#bring-your-own-model https://llm.mlc.ai/docs/deploy/ios.html#bring-your-own-model