3 ms·
>Also a sentence like "programming perl is fun" does not necessarily refer to the book. ...but the counts might be low enough to manually check for those insta
by flubert 11y ago
>Also a sentence like "programming perl is fun" does not necessarily refer to the book.
...but the counts might be low enough to manually check for those instances. I'm surprised the counts are so low.
- gkst 11y agoThe counts would be a lot higher I guess, if I searched for book titles instead of links to a particular shop.
- tedmiston 11y agoI know we traditionally process tokens as case-insensitive, but... it seems reasonable to assume in HN comments that book titles would be capitalized properly (so we could ignore non-capitalized titles). Whether or not this information is present in the version on BigQuery, I'm not sure though.
- gkst 11y agoThe full text of the comment is available on BigQuery, but I can't write an SQL query that returns all comments containing potential book titles. To do such an analysis I'd need to download all 8M comments and process them individually and find a good way to detect book titles.