3 ms·
Do you use any kinda algorithm for crawling/fetching content from reddit?
by ksashikumar 10y ago
Do you use any kinda algorithm for crawling/fetching content from reddit?
- rezashirazian 10y agoNot particularly. The one thing that helps but most people don't know about reddit is the fact that adding a .json to the end of each url displays the content of that page in json format. for example: reddit.com/r/funny.json This make crawling/fetching content from reddit much more trivial than old school web crawling.