4 ms·
I can run Mistral 7B, in 3-bit quantization, on my phone, and I get helpful answers for (just today) seeing environment variables in Python.
by lsb 3y ago
I can run Mistral 7B, in 3-bit quantization, on my phone, and I get helpful answers for (just today) seeing environment variables in Python.
- AlexAndScripts 3y agoWhat do you use to run it on your phone?
- lsb 3y agoThe iOS app “MLCChat”