3 ms·
Yes, that’s my understanding. One advantage of summing is that the lower frequency terms hardly change for a small text, so effectively there is more capacity
by tlb 3y ago
Yes, that’s my understanding.
One advantage of summing is that the lower frequency terms hardly change for a small text, so effectively there is more capacity for embeddings with short texts, while still encoding order in long texts.