3 ms·
Is anybody else seeing an absolutely massive amount of Amazonbot crawls on their site? What are they up to? And why so aggressively?
by kylehotchkiss 2y ago
Is anybody else seeing an absolutely massive amount of Amazonbot crawls on their site? What are they up to? And why so aggressively?
- n_ary 2y agoMost likely aspiring AI startups gathering as much data as they can before regulation jaws snap shut around them cutting off the blood stream. In this AI race(hype), data is finally the ultimate gold. Also at the rate the information is polluted by GenAI junk all over, any remnants of real data is holy grail.
- kylehotchkiss 2y agoSo any unknown or upcoming AIs would just show as Amazon?
- nitwit005 2y agoThey have documentation on verifying if it is indeed their bot: https://developer.amazon.com/amazonbot https://developer.amazon.com/amazonbot