3 ms·
“3,850 requests per second” to hacker news? Sounds like a denial of service attack ;)
by alex_young 6y ago
“3,850 requests per second” to hacker news? Sounds like a denial of service attack ;)
- MoOmer 6y agoAgreed, it would have been nice to see some sort of delay or rate limit.
- thomasdziedzic 6y agoThanks for the suggestion. Added a rate_limit parameter to my script to play nicely with the api :) https://github.com/thomasdziedzic/hackernews-etl/commit/6dff5c1fdc53785b1c7ea83fed913cc3c586f594 https://github.com/thomasdziedzic/hackernews-etl/commit/6dff...
- thomasdziedzic 6y agoAh thanks for mentioning this. I looked at the blog post and I seem to have prefixed an extra 1 to the number of requests done by my python script. I updated the post to include the actual calculation of 402 requests per second which is a lot less impressive but still much faster than my original approach on half the hardware.
- eat_veggies 6y agoThe hacker news API is served by firebase -- I'm sure google's infrastructure can handle that traffic