3 ms·
Thanks again, very interesting. One unexpected (to me) use-case appeared not long ago when I found myself without internet but wanting to fix some non-standard
by magicalhippo 2y ago
Thanks again, very interesting.
One unexpected (to me) use-case appeared not long ago when I found myself without internet but wanting to fix some non-standard Linux configuration issue. As a Windows guy I tend to web search such things, but local LLM to the rescue!
Even smaller models like Gemma 2 9B has enough compressed knowledge that it managed to help me quickly solve my issue.
This got me thinking how such smaller, but very capable models might be a game-changer in communities where internet might not be available or too expensive for continuous use. It's almost like having a portion of the internet in a box, just add electricity.
- alekandreev 2y agoThank you for the feedback! This is why we are so excited to push more and more on small models for both low end and high end smartphones!