3 ms·my understanding is possibly, but not in violation of robots.txtby x0x0 10y agomy understanding is possibly, but not in violation of robots.txt