4 ms·
"The aim of indexing is to internalize the corpus into the parameters of LLM." They train the LLM directly on the corpus so that the documents are embedded in
by intalentive 3y ago
"The aim of indexing is to internalize the corpus into the parameters of LLM."
They train the LLM directly on the corpus so that the documents are embedded in its weights.
There are some ESL issues in the paper but it's not too hard to understand.
- swyx 3y ago> They train the LLM directly on the corpus so that the documents are embedded in its weights. they do not outright say that in the paper as far as i could tell. i only got it from reading hn comments. just very confused why they use a nonstandard term like "internalize" which just pisses me off because ML is hard enough without inventing your own terms