2 ms·
Decent local LLMs such as Vicuna-7B are already able to run on phones with 8 GB RAM: https://mlc.ai/mlc-llm/ https://mlc.ai/mlc-llm/ Right now it's a prototype
by Vuizur 3y ago
Decent local LLMs such as Vicuna-7B are already able to run on phones with 8 GB RAM: https://mlc.ai/mlc-llm/ https://mlc.ai/mlc-llm/
Right now it's a prototype, but in the future local LLMs will be everywhere.
- bavell 3y agoI really, really hope this is the case. Trying to be optimistic about this in spite of my skeptical nature :)