3 ms·
I don't understand how this could work. Like if you select a small fixed number of tokens from a large document won't you necessarily lose a lot of important d
by im3w1l 4y ago
I don't understand how this could work. Like if you select a small fixed number of tokens from a large document won't you necessarily lose a lot of important data?
- MagicMoonlight 4y agoWhen you read a book do you remember every word? Even every chapter? You only need the important concepts, not individual words
- Xelynega 4y agoI feel that's a bit different. When skimming or reading a book, even though we don't remember all the information typically a lot of the information is dependent on prior information, so we form a sparse knowledge graph from the entire text. If I'm understanding the article, this approach would not use the skipped words to influence the output, so I thinks ita necessarily different.