5 ms·

Thanks! Here is a study on average sentence length showing it at 24 words per sentence: http://ds.nahoo.net/Academic/Maths/Sentence.html http://ds.nahoo.net/A

by alok-g 14y ago

Thanks! Here is a study on average sentence length showing it at 24 words per sentence: http://ds.nahoo.net/Academic/Maths/Sentence.html http://ds.nahoo.net/Academic/Maths/Sentence.html In my own study, I performed analysis on a corpus of a few hundred million sentences of written text and found it at 31 words per sentence. It would be great if you can point to the use of GPU for parsing. I had never heard of the bitpar parser, will look into it.

andreasvc 14y ago
http://scholar.google.nl/scholar?hl=en&q=CKY+GPU&btnG=&as_sdt=1%2C5&as_sdtp= http://scholar.google.nl/scholar?hl=en&q=CKY+GPU&btn...
andreasvc 14y ago
My average sentence length of 15 came from a bunch of literary novels. The non-literary fiction had even less, at 11 words. There is obviously quite some variance here, but actually it shouldn't matter for a parser because humans appear to parse in linear time (given a well written sentence).