4 ms·
Personal LLMs make a lot of sense. Until they don't. Right now, having a OCR combined with an LLM would open the way to a personalized assistant (rather a well
by choeger 3y ago
Personal LLMs make a lot of sense. Until they don't.
Right now, having a OCR combined with an LLM would open the way to a personalized assistant (rather a well working search machine and letter/email generator). No need to manually manage or catalogue documents, photos, videos, contacts, it would all be available by grepping your input stream smartly.
But once everyone uses such a tool, why bother generating human-readable text in the first place? There's so much efficiency to be gained: Send plaintext instead of html or pdf. Replace plaintext with its embedding. The sending AI could learn what the receiver understands. Finally, don't send stuff at all. Just point to the relevant vector DB entry.
In the end, the LLM itself will be obsolete, except as an appendix to communicate with humans. For all other tasks it will be superseded by a evolvednit engineered, form of machine-to-machine language.