2 ms·
Reading through all your private documents and extracting the useful information to answer an open ended question like this is still a little way off. Specific
by londons_explore 4y ago
Reading through all your private documents and extracting the useful information to answer an open ended question like this is still a little way off.
Specifically, LLM's can generally only take into account ~8000 words of context when deciding on a response. Summarizing the question and all necessary information for the answer into 8000 words is hard when the user might have millions of words in their inbox.
Having said that, I don't think it's far off. There are already prototypes of LLM's which have information retrieval abilities (ie. it could do a keyword search of your inbox to find a few relevant documents to read to decide on a response). There are also promising efforts to make that 8000 word number far larger.