Hi, we are currently in the process of building an enterprise-scale crawler. However, for the purpose of this beta test, we simply chose a few pages to index to

Hi, we are currently in the process of building an enterprise-scale crawler. However, for the purpose of this beta test, we simply chose a few pages to index to validate the effectiveness of our idea.