5 ms·
Let's not forget the part where people write shitty scripts that bombard your server with 10x the quantity of traffic you see from actual users. There's shitti
by remus 9y ago
Let's not forget the part where people write shitty scripts that bombard your server with 10x the quantity of traffic you see from actual users.
There's shittiness from both producers and consumers.
- DanielBMarkham 9y agoAgreed. It's a terrible waste of time, money, and energy from tens of thousands of people. All for nothing.
- emodendroket 9y agoI think you might be misunderstanding. Someone's scripted use of a Web site can burn more resources, he's saying, but it's not "for nothing" -- they're deriving some benefit from the scripting.
- TeMPOraL 9y agoThey wouldn't have to do that if the website wasn't - purposefully or through crappy engineering - making the data unnecessarily difficult to get and process by machines.
- intrasight 9y agoProducers should the make a rate-limited API - and even charge for it
- TeMPOraL 9y agoOr rate-limit the website itself - if you're dealing with scrappers.