2 ms·
At [a certain auto website I used to work at] the bot traffic was a significant amount of the requests... Because of the nature of referal traffic we were requ
by tracker1 10y ago
At [a certain auto website I used to work at] the bot traffic was a significant amount of the requests... Because of the nature of referal traffic we were required to let the bot traffic stand...
This was mitigated by implementing a few layers of a decent caching strategy, as well as some db improvements, and moving search queries to a separate database server (mongodb, then elasticsearch) altogether.
In the end, there are lot of things you can do to help mitigate these things... It really just depends on what you are trying to accomplish with a given site.