jonathan-kosgei

10 ms·

1. 61.▲
   Ask HN: What highly scalable thing have you built with Go?

   102 points by jonathan-kosgei 8y ago|75 comments
2. 62.▲
   by jonathan-kosgei 8y ago

   Not particularly no.
3. 63.▲
   by jonathan-kosgei 8y ago

   Waf would've required setting up cloudfront in front of our endpoints which would've increased latency. Basic Shield is supposed to be on for all users but I don't think APIG is covered in the range of services covered by the
4. 64.▲
   by jonathan-kosgei 8y ago

   At some point the fixed cost of real servers does become appealing.
5. 65.▲
   by jonathan-kosgei 8y ago

   We were wary of limiting paid users. Even with lambda's max concurrent function executions limit, when the function completes in a few milliseconds, the number of invocations per second can still be high.
6. 66.▲
   by jonathan-kosgei 8y ago

   At ipdata.co we use the same APIG+Lambda setup replicated in 11 regions to have the lowest latencies globally. We had to do some extra work to get API keys and rate limiting working but it was worth it. Our setup averages ~44ms response tim
7. 67.▲
   by jonathan-kosgei 8y ago

   We actually found this out the hard way. We got DDoS'd and cloudwatch was our second most expensive item after API Gateway. Lambda and Dynamodb were almost insignificant.
8. 68.▲
   by jonathan-kosgei 8y ago

   We also found that using lambda to process kinesis logs was incredibly slow and definitely not the best use case for lambda. We had much better results running a server with a couple of kinesis consumers and redis. This setup was able to pr
9. 69.▲
   by jonathan-kosgei 8y ago

   As of May 14, lambda@edge supports node8 https://aws.amazon.com/about-aws/whats-new/2018/05/lambda-at...
10. 70.▲
    by jonathan-kosgei 8y ago

    This is brilliant! I hadn't yet found any reason to mess with Raspberry Pis. But the way you've described it makes a lot of sense. They'd definitely be a maintenance overhead, uptime wouldn't be guaranteed but I can imag
11. 71.▲
    by jonathan-kosgei 8y ago

    There's also https://github.com/rpgreen/apilogs but I haven't yet gotten it to work. Cloudwatch feels like it was not made for humans. Searching and filtering for specific log events is a huge pain. I think o
12. 72.▲
    by jonathan-kosgei 8y ago

    One of the best things we did at ipdata was start using Sentry in our lambda functions. We caught an unbelievable number of silent errors that would've been impossible to find with cloudwatch.
13. 73.▲
    by jonathan-kosgei 8y ago

    We got DoS'd with a few hundred million calls over a few days and the dynamodb cost was about $4.
14. 74.▲
    by jonathan-kosgei 8y ago

    Any links on how to implement your email routing setup?
15. 75.▲
    by jonathan-kosgei 8y ago

    >We're starting to ramp up traffic now by orders of magnitude (with many more to come) and it's soooooo awesome knowing the stack is pretty much bombproof. This does come with additional cost. Serverless pricing doesn't sc
16. 76.▲
    by jonathan-kosgei 8y ago

    I've felt the same way. Serverless is most appealing when you're starting out and have low traffic. It enabled us at ipdata.co to have the most global infrastructure possible with the lowest latencies at an insignificant cost. At
17. 77.▲
    Ask HN: Help How Do You Mitigate a HTTP GET Flood DoS

    2 points by jonathan-kosgei 8y ago|1 comments
18. 78.▲
    by jonathan-kosgei 8y ago

    No one has mentioned gogs yet https://gogs.io/
19. 79.▲
    by jonathan-kosgei 8y ago

    Thanks for the feedback, this does help. I'm wary of adding another step before users can get started with the API but it might become necessary to do so. Thanks again!
20. 80.▲
    by jonathan-kosgei 8y ago

    I can see all the ip addresses from multiple countries. Via announcements on the website. Some are but others aren't.
21. 81.▲
    by jonathan-kosgei 8y ago

    Nope, you can call our endpoint without an API key but you'd be limited to 1500 requests a day.
22. 82.▲
    Ask HN: Requiring users to sign up for free trial. Yay or nay?

    2 points by jonathan-kosgei 8y ago|6 comments
23. 83.▲
    Ask HN: Would you not use an API if it's free trial required you to sign up?

    1 points by jonathan-kosgei 8y ago|2 comments
24. 84.▲
    Ask HN: What's the best way to store company private keys?

    5 points by jonathan-kosgei 8y ago|1 comments
25. 85.▲
    Ask HN: What's the best/fastest image processing library?

    1 points by jonathan-kosgei 8y ago|2 comments
26. 86.▲
    by jonathan-kosgei 8y ago

    That's a pretty interesting history and put in that perspective I see what you mean and totally agree with you.
27. 87.▲
    by jonathan-kosgei 8y ago

    It's pretty obvious that hitting your local disk is going to be a lot faster than making a network call. Make the right decision for your use case.
28. 88.▲
    by jonathan-kosgei 8y ago

    Comparing a network call vs filesystem i/o wouldn't be a useful comparison for someone deciding between different third part API providers.
29. 89.▲
    by jonathan-kosgei 8y ago

    I understand what you mean, but every other provider from the tests I've done comes in at double our speeds some even over plain HTTP. We only serve requests over HTTPS More importantly the performance is consistent and you'd get
30. 90.▲
    by jonathan-kosgei 8y ago

    Thanks! :)