3 ms·
For me, I expect LLMs to become significantly more useful when enabled with multi-session continuity and access to a persistent store of data personally relevan
by mrandish 4y ago
For me, I expect LLMs to become significantly more useful when enabled with multi-session continuity and access to a persistent store of data personally relevant to me. Of course, these are also things which tend to increase the security, privacy and abuse surfaces of LLMs.
What I hope someone comes up with is an open standard which lets me choose when to allow an LLM private, temporary 'merge access' to my personal data (eg emails, documents, calendar, browsing history, online posts across platforms and accounts, chats, etc). If no vendor offers something like this then I'll probably host my own private LLM based on whatever the best available open source project is.
- braingenious 4y agoI agree! I am excited for the future of all this. Today I managed to get Alpaca 13B running locally on my laptop and I’m really impressed. I look forward to being about to run 65B with my next hardware upgrade, though I suspect something even better will be available by the time I get around to actually buying anything.
- mrandish 4y agoRunning a decent LLM on a laptop is super impressive though I expect I'd run a personal LLM on a server for 24/7 availability, backup, etc. It'll be interesting to see if people like us HNers end up running our own full LLMs on open source for privacy, security and control reasons or if an acceptable solution is worked out which allows keeping our personal data blobs separate but able to be temporarily securely accessed.