4 ms·
> In the end, the conclusion is that there’s no real way to us fix this that would stop “attacks” against small consumer grade sites without also significantly
by ama729 12y ago
> In the end, the conclusion is that there’s no real way to us fix this that would stop “attacks” against small consumer grade sites without also significantly degrading the overall functionality.
Why not just limit the number of request per site and per user? Ie. John Smith can only make X request (let say 1000) to www.google.com.
Doesn't seem too hard.
- eyeareque 12y agoThey state that 400-800 mbit/s == consumer grade sites? really?
- mscarborough 12y agoWhen you're as totally awesome and uncaring about your customers as Facebook, you can toss out words like "consumer grade" to describe people affected by your fuck-ups.
- silentOpen 12y agoDownload fast and break (other people's) things.
- MichaelGG 12y agoOutbound traffic. That's only serving up a few large images a second. It's entirely IO bound on network output. Getting a 1Gbps connection is not a big deal.
- iancarroll 12y agoI don't know what your setup is like but a connection != the requests my webserver can handle.
- MichaelGG 12y agoI know, it was two separate comments. A: It's "just" IO, performing probably the most heavily optimized IO pattern in the world (serving static files) and B: buying a 1Gbps uplink is trivial.
- chr13 12y ago>"buying 1Gbps uplink is trivial" 1 Gbps dedicated uplink is not trivial everywhere in the world. You also need more quota. Facebook easily crawled more than 1 TB of data during an hour. The more the better may not be best solution here. The higher the uplink, faster Facebook may crawl. So instead of transfering 1 TB in an hour for a 1 Gbps uplink, the transfer will be 10 TB if you have 10 Gbps. This will also depend how much bandwidth they allow their crawler, there must be an upper limit though.
- michaelt 12y agoServing 1Gbps of traffic from Amazon S3 would cost $250,000 a year. Maybe that's not a big deal to you, but it would be to me!