4 ms·
https://www.nytimes.com/2005/01/30/books/review/tool-for-thought.html https://www.nytimes.com/2005/01/30/books/review/tool-for-tho... > There's a fundamental d
by walterbell 4y ago
https://www.nytimes.com/2005/01/30/books/review/tool-for-thought.html https://www.nytimes.com/2005/01/30/books/review/tool-for-tho...
> There's a fundamental difference between searching a universe of documents created by strangers and searching your own personal library. When you're freewheeling through ideas that you yourself have collated -- particularly when you'd long ago forgotten about them -- there's something about the experience that seems uncannily like freewheeling through the corridors of your own memory. It feels like thinking.
Has anyone applied a local-only LLM to their personal library?
- graboid 4y agoI think a lot of people are thinking about that right now. At least I read that idea a lot here on HN and on Twitter. I personally cannot wait to try it. But for now, I wait until there are better options for local LLMs. Given the current development speed of all things AI, probably that won't take too long.
- nmcfarl 4y agoI’ve not tried it but this Obsidian plugin does exactly this to your notes: https://github.com/exoascension/vault-chat/tree/main https://github.com/exoascension/vault-chat/tree/main I think it’s just a matter of time to scale it to something larger.
- rpastuszak 4y agoThanks for sharing, but bear in mind that this plugin sends data to Open AI.
- nmcfarl 4y agoIt certainly does — and I expect anything in this space that gets successfully commercialized will likewise siphon all of your personal data into a large corporation. But then I am a pessimist about these matters.
- walterbell 4y agoAs a positive precedent, OpenAI's Whisper speech recognition is open-source and can be run locally with zero data exposure, https://www.newyorker.com/tech/annals-of-technology/whispers-of-ais-modular-future https://www.newyorker.com/tech/annals-of-technology/whispers... Some progress with local LLMs: https://arstechnica.com/information-technology/2023/03/you-can-now-run-a-gpt-3-level-ai-model-on-your-laptop-phone-and-raspberry-pi/ https://arstechnica.com/information-technology/2023/03/you-c... > Things are moving at lightning speed in AI Land. On Friday, a software developer named Georgi Gerganov created a tool called "llama.cpp" that can run Meta's new GPT-3-class AI large language model, LLaMA, locally on a Mac laptop. Soon thereafter, people worked out how to run LLaMA on Windows as well. Then someone showed it running on a Pixel 6 phone, and next came a Raspberry Pi (albeit running very slowly).