2 ms·A well made crawler that would support 429 codes isn't likely to have this problem in the first place.by jandrese 6y agoA well made crawler that would support 429 codes isn't likely to have this problem in the first place.