4 ms·
I know we traditionally process tokens as case-insensitive, but... it seems reasonable to assume in HN comments that book titles would be capitalized properly (
by tedmiston 11y ago
I know we traditionally process tokens as case-insensitive, but... it seems reasonable to assume in HN comments that book titles would be capitalized properly (so we could ignore non-capitalized titles). Whether or not this information is present in the version on BigQuery, I'm not sure though.
- gkst 11y agoThe full text of the comment is available on BigQuery, but I can't write an SQL query that returns all comments containing potential book titles. To do such an analysis I'd need to download all 8M comments and process them individually and find a good way to detect book titles.