3 ms·
I think it’s a very interesting approach. Could be for a niche group, likely power users of LLMs who are often mobile and value privacy. Any thoughts on how sm
by yamatokaneko 1y ago
I think it’s a very interesting approach. Could be for a niche group, likely power users of LLMs who are often mobile and value privacy.
Any thoughts on how small this hardware could eventually become?
- itstomo 1y agoLooks like the hardware needed to run state-of-the-art open source LLM will be ~100kg... haha It's not feasible today. Someday!