4 ms·
Is the actual data available for download yet? I'm just seeing hundreds of meta-data XML files.
by xhrpost 14y ago
Is the actual data available for download yet? I'm just seeing hundreds of meta-data XML files.
- Mithrandir 14y agoI don't think so. If you go to one of the items (e.g. https://ia601408.us.archive.org/18/items/cuil-domainshard-corpus5-large-merge-rev1.00355-of-25000/ https://ia601408.us.archive.org/18/items/cuil-domainshard-co...) and try downloading one of the .arc.gz files, you'll get a message saying "The item is not available due to issues with the item's content." I've seen this happen before with other crawls, like for Youtube (https://ia600301.us.archive.org/26/items/IA-YOUTUBE-000-20070509025513-45711-crawling02.us.archive.org/ https://ia600301.us.archive.org/26/items/IA-YOUTUBE-000-2007...) It could be a copyright issue or to keep bandwidth low, but I don't know for sure.