5 ms·
It sounds like they wanted to do the scraping themselves, but for anyone else who wants to play with this data, it's available for download at http://xd.saul.pw
by rabidrat 9y ago
It sounds like they wanted to do the scraping themselves, but for anyone else who wants to play with this data, it's available for download at http://xd.saul.pw/data http://xd.saul.pw/data.
- slig 9y agoAlso here: https://github.com/doshea/nyt_crosswords https://github.com/doshea/nyt_crosswords and a couple of other repos on GH.
- rabidrat 9y agoThanks for posting this, but not all data is created equal. These crosswords only go back to 1976, are in .json format, and require nontrivial processing to get into a useful format for data analysis. By contrast, I very meticulously designed the formats available at xd.saul.pw to be easy to use. You can even extract some interesting results with just e.g. `grep` and `wc`.
- slig 9y agoThank you, I did not realize at first that the link you posted is so complete! I PM'd you on reddit a little while ago asking for the dataset, but didn't have the time to play with it yet. Thanks again for your time and consideration.