3 ms·
It's already a race to the bottom. Deepseek v2 lite is a damn good model that runs on old hardware already (but its slow). In 2-3 years we will likely have ha
by bearjaws 2y ago
It's already a race to the bottom.
Deepseek v2 lite is a damn good model that runs on old hardware already (but its slow).
In 2-3 years we will likely have hardware that runs 70b parameter models with enough speed that you will run it locally.
Only when you have difficult questions will you actually pay.
For example I already use https://cluttr.ai https://cluttr.ai to index my screen shots and it costs me $0.
(I made this tool tho)
- metadat 2y agoNeat idea. Is there a self-hostable version of this? I can't upload my screenshots to a 3rd party, because they contain lots of proprietary info.
- quaintdev 2y agoSomebody made it for searching memes few days ago https://www.reddit.com/r/selfhosted/comments/t33rx5/just_released_jina_30_selfhosted_ai_powered/ https://www.reddit.com/r/selfhosted/comments/t33rx5/just_rel...
- bearjaws 2y agoTotally understand, and it can't be local first without OSS. I'll be making it OSS with an Electron App soon.
- countvonbalzac 2y agoYou misspelled screenshots in the title of your website.
- bearjaws 2y agoDerp lol, I'll fix it when I get home
- ugh123 2y agoI think thats a great use case put AI tasks in the background for document processing and indexing into structured data.