3 ms·
i need someone to explain this paper in direct language, because this paper keeps saying things like "internalizes the corpus to retrieve into a LLM via a natur
by swyx 3y ago
i need someone to explain this paper in direct language, because this paper keeps saying things like "internalizes the corpus to retrieve into a LLM via a natural language indexing architecture." but never ever explains what the heck "internalizing" means, and where the "natural language index" sits in the architecture. Figure 2 is the only thing somewhat resembling an arch diagram and just uses these vague undefined terms to describe it. am i missing something or just voicing the same confusion everyone else has?
- manojlds 3y agoTry using Claude and ask questions about the paper
- beardedwizard 3y agoI sometimes think there is a hidden language these papers use. To what end is not clear.
- intalentive 3y ago"The aim of indexing is to internalize the corpus into the parameters of LLM." They train the LLM directly on the corpus so that the documents are embedded in its weights. There are some ESL issues in the paper but it's not too hard to understand.
- swyx 3y ago> They train the LLM directly on the corpus so that the documents are embedded in its weights. they do not outright say that in the paper as far as i could tell. i only got it from reading hn comments. just very confused why they use a nonstandard term like "internalize" which just pisses me off because ML is hard enough without inventing your own terms