3 ms·
There's some other reasons to run local LLMs. If it's on my PC, I can preload the context with, say, information about all the members of my family. Their bir
by kbelder 1y ago
There's some other reasons to run local LLMs. If it's on my PC, I can preload the context with, say, information about all the members of my family. Their birthdays, hobbies, favorite things. I can load in my schedule, businesses I frequent. I can connect it to local databases on my machine. All sorts of things that can make it a useful assistant, but that I would never upload into a cloud service.