3 ms·
A 5 page PDF report has X amount of bits of information, whereas a paragraph has ~X/25 (5 paragraphs per page) amount of bits. Its an impossible task to retain
by imranq 4y ago
A 5 page PDF report has X amount of bits of information, whereas a paragraph has ~X/25 (5 paragraphs per page) amount of bits. Its an impossible task to retain the same information.
But it might be interesting to create an Autoencoder for text that creates a compressed embedding that can recreate the original article. That embedding can be used for summary creation and all sorts of downstream tasks
- Zababa 4y agoThat seems false, bits may be unnecessary for information, or follow a pattern. For example: apple fox apple fox apple fox apple fox apple fox apple fox apple fox apple fox apple fox 9 times "apple fox" Same information, less bits.
- soheil 4y agoSo the point I am trying to make is to compress the concepts instead of just the bits now that we AI that seems to understand our words and thoughts.