5 ms·
Whats are some use cases for these local small models, for individuals? Seems like for programming related work, the proprietary models are significantly better
by nsingh2 1y ago
Whats are some use cases for these local small models, for individuals? Seems like for programming related work, the proprietary models are significantly better and that's all I really use LLMs for personally.
Though I can imagine a few commercial applications where something like this would be useful. Maybe in some sort of document processing pipeline.
- russdill 1y agoHoping to try it out with home assistant.
- toddmorey 1y agoI think speech to text is the highlight used case for local models because they are now really good at it and there’s no network latency.
- oezi 1y agoHow does it compare to whisper? Does it hallucinate less or is more capable?
- androng 1y agofiltering out spam SMS messages without sending all SMS to the cloud
- thimabi 1y agoI’m thinking about building a pipeline to mass generate descriptions for the images in my photo collection, to facilitate search. Object recognition in local models is already pretty good, and perhaps I can pair it with models to recognize specific people by name as well.
- jsphweid 1y agoFor me? Handling data like private voice memos, pictures, videos, calendar information, emails, some code etc. Stuff I wouldn't want to share on the internet / have a model potential slurp up and regurgitate as part of its memory when the data is invariably used in some future training process.
- msabalau 1y agoI just like having quick access to reasonable model that runs comfortably on my phone, even if I'm in a place without connectivity.