3 ms·
Jeez 3.1GB … what’s the advantage of having the LLM on device?
by realitysballs 3y ago
Jeez 3.1GB … what’s the advantage of having the LLM on device?
- 5cott0 3y agoMy own personal convenience so I don't have to maintain a third party api subscription and the user's privacy–maybe someone wants to ask it a personal question that they don't want transmitted to a 3rd party, used to train other llms, etc.