4 ms·
There is definitely interest in providing off-grid communities easy access to lightweight LLMs... one idea is to use something like: https://github.com/mlc-ai/w
by n8fr8too 3y ago
There is definitely interest in providing off-grid communities easy access to lightweight LLMs... one idea is to use something like: https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm to deliver it in a browser
- cush 3y agoOh I see. Was confused. The “this” in OP’s comment is an offline library. An offline LLM would be nice too.
- qgin 3y agoYeah, to clarify, I didn't mean it would be a direct replacement for literature, just that on the same theme of of providing a resource in places where connectivity is an issue, an LLM is a reasonable way to compress a whole lot of human knowledge into a relatively small space in a usable form.