5 ms·

Can you expand on the types of abuse you saw? Was it all just spam, or was some of it legitimately 'dodgy' ?

• stevekemp 6y ago
  A combination of (bot) IP addresses making 20+ requests a second, to post SPAM. Half the abuse was people just making lots of requests in short spaces of time, the other half was just people submitting spam, more slowly. I added rate-limiting to deal with the worst offenders, but mostly they'd keep POSTing away, ignoring the error-codes I was sending. All submissions would get a random ID, something like this example chosen at random: https://markdownshare.com/view/b5abadcc-c0fb-473e-a34d-f27c0921865d https://markdownshare.com/view/b5abadcc-c0fb-473e-a34d-f27c0... There were numerous bots who'd try to spider/probe the site collecting all the links. Handling millions of 404s a month wasn't much of a pain, because the service was pretty efficient, but it was just another source of annoyance. Finally, and God only knows how, I'd get a ton of DCMA takedown notices for alleged copyright infringement. That's what pushed me over the edge into first of all making it read only, and secondly planning to kill it at the end of the year.
  • Jaruzel 6y ago
    Wow thanks for that. Makes one stop and think before coding anything similar. :(
  • abi 6y ago
    What do people gain from spamming your service? Referring especially to the ones that kept going despite error codes being sent their way.
    • stevekemp 6y ago
      Just bots spamming forms I guess, hoping to get indexed and ranked on google. The same thing you see on random blogs, I don't think there's anything specific about my service in particular - just badly coded bots that don't have retry logic and blindly spam the same content to thousands of sites that accept comments, content, and pingbacks.
      • abi 6y ago
        Ahhhh they are trying to collect backlinks. That makes sense.