3 ms·
The corpus seems oddly constructed. I have to wonder where they got the English text from -- it seems to have a very academic bias, with lots of strings contain
by duskwuff 12y ago
The corpus seems oddly constructed. I have to wonder where they got the English text from -- it seems to have a very academic bias, with lots of strings containing "University", for instance. There's also a lot of redundancy; for instance, I see some near-duplicates including:
12010. "University of"
12129. "University of "
13106. "the University of"
13227. "Oxford University"
13534. " Oxford University"
(I'm sure there's other similar duplicates; I just happened to notice them while looking at all the "university"-ies in the corpus.)
- acqq 12y agoIt's really strange standard. For those that didn't analyze: It's part of the "static dictionary given in Appendix A" which has to be present in any implementation. Especially if we know it's supposed to be used to compress the fonts.
- robryk 12y agoHmm.. that's really strange, given that one of the dictionary transformations available (number 12) strips the last letter from the dictionary word and another (number 3) strips the first letter from the word.