4 ms·
Small context window means you cannot embed the whole document, you are embedding just a part. So, if there is some information at the bottom which is dependen
by cztomsik 3y ago
Small context window means you cannot embed the whole document, you are embedding just a part.
So, if there is some information at the bottom which is dependent on something which is at the top, your embedding could be entirely wrong.