4 ms·

Yeah, Bing has gone completely nuts the last six months or so. They'll happily send the equivalent of a small DDoS at sites hosted on shared hosting, knocking t

by 2000UltraDeluxe 3y ago

Yeah, Bing has gone completely nuts the last six months or so. They'll happily send the equivalent of a small DDoS at sites hosted on shared hosting, knocking them completely offline for a while. Nuts.

herbst 3y ago
Could have been in the last 6 months for me too. And yes its crazy, most my sites have between 8 and 16 concurrent database connections available. In real world this works for thousands of daily users. But for a bing bot it's simply not enough.
- hammyhavoc 3y ago
  Why aren't you caching your forum as static pages for users who aren't logged in at the very least? E.g., rebuild the cache every x time as a cron task, but even then, every page load shouldn't be incurring database overhead if someone isn't even logged in. Equally, you can force a rebuild of cache for x relevant pages when someone posts a new thread or comment. Otherwise, if someone alt+clicks a bunch of a category's threads as they look interesting then you're going to have a bad time.
  - arpa 3y ago
    Effort vs payoff is my educated guess.
    - hammyhavoc 3y ago
      Few minutes of work for a permanent payoff? It's a no-brainer.
  - herbst 3y ago
    I am not the forum guy and my content is not really static. It's cached, but for this specific sub page I need at least one small query. Only a few requests are rebuilding the page, but if every 10th is rebuilt and 9 other bots are hammering mostly cached pages I still have the same issue. The bot was never ment to query the same pages thousands of times. These pages were identical to him. There were already bot specific rules programmed in. This website already is heavily cached and optimized. Even thought it only has 16 database connections there maybe is one timeout every few months. Users usually don't open tabs much faster than the short requests take, only bing does. Really the time that went into optimizing it makes me kinda sad when someone questions that is was a effort Vs payoff thing. The bot ignored all rules I gave him and barely brought any benefit for me in terms of traffic. There is no payoff here, only effort.
victor106 3y ago
Same here, we decided to actively block Bing. It’s the most useless egress traffic we have to pay for. Go away Bing.

herbst 3y ago

Could have been in the last 6 months for me too. And yes its crazy, most my sites have between 8 and 16 concurrent database connections available. In real world this works for thousands of daily users. But for a bing bot it's simply not enough.

hammyhavoc 3y ago
Why aren't you caching your forum as static pages for users who aren't logged in at the very least? E.g., rebuild the cache every x time as a cron task, but even then, every page load shouldn't be incurring database overhead if someone isn't even logged in. Equally, you can force a rebuild of cache for x relevant pages when someone posts a new thread or comment. Otherwise, if someone alt+clicks a bunch of a category's threads as they look interesting then you're going to have a bad time.
- arpa 3y ago
  Effort vs payoff is my educated guess.
  - hammyhavoc 3y ago
    Few minutes of work for a permanent payoff? It's a no-brainer.
- herbst 3y ago
  I am not the forum guy and my content is not really static. It's cached, but for this specific sub page I need at least one small query. Only a few requests are rebuilding the page, but if every 10th is rebuilt and 9 other bots are hammering mostly cached pages I still have the same issue. The bot was never ment to query the same pages thousands of times. These pages were identical to him. There were already bot specific rules programmed in. This website already is heavily cached and optimized. Even thought it only has 16 database connections there maybe is one timeout every few months. Users usually don't open tabs much faster than the short requests take, only bing does. Really the time that went into optimizing it makes me kinda sad when someone questions that is was a effort Vs payoff thing. The bot ignored all rules I gave him and barely brought any benefit for me in terms of traffic. There is no payoff here, only effort.

victor106 3y ago

Same here, we decided to actively block Bing. It’s the most useless egress traffic we have to pay for. Go away Bing.