2 ms·
If Quora plan to pivot, they should change their robots.txt [1] so that Archive.org can crawl their website or post their data dumps like StackOverflow [2]. Oth
by frik 13y ago
If Quora plan to pivot, they should change their robots.txt [1] so that Archive.org can crawl their website or post their data dumps like StackOverflow [2]. Others came to the same conclusion today [3].
[1] https://web.archive.org/web/http://www.quora.com/ https://web.archive.org/web/http://www.quora.com/
[2] http://blog.stackoverflow.com/2009/06/stack-overflow-creative-commons-data-dump/ http://blog.stackoverflow.com/2009/06/stack-overflow-creativ...
[3] https://news.ycombinator.com/item?id=7723291 https://news.ycombinator.com/item?id=7723291