hrez

21 ms·

1. 181.▲
   by hrez 10y ago

   Yep, serving 503 or otherwise broken app to users is not acceptable LB behavior. Nginx aficionados fail to comprehend that somehow. Which I guess shows that nginx is web server first and proxy/LB second.
2. 182.▲
   by hrez 10y ago

   For reverse-proxy/LB it kinda sucks. No standard healthchecks for a long-long time and nowdays only in commercial version? Yes, you can compile in 3d party plugin but that just underscores the lacking.
3. 183.▲
   by hrez 10y ago

   try https://github.com/rlmcpherson/s3gof3r you can often get wire speed
4. 184.▲
   by hrez 11y ago

   Oracle supported way would be to use Oracle Linux for that.
5. 185.▲
   by hrez 11y ago

   Skype is most bloated app on my desktop excluding browsers. Currently it takes 169Mb of memory doing nothing.
6. 186.▲
   by hrez 11y ago

   Apparently it consumes variable number of IP addresses on VPC subnet. I wish it just NAT-ed into it.
7. 187.▲
   AWS: Access Resources in a VPC from Your Lambda Functions(aws.amazon.com)

   3 points by hrez 11y ago|1 comments
8. 188.▲
   by hrez 11y ago

   If you use it to glue/pipe bunch of tools written in C it can easily be faster.
9. 189.▲
   by hrez 11y ago

   Isn't it BSD based or that happened only after "first 15 years"?
10. 190.▲
    by hrez 11y ago

    Yes, except with ec2 and tons of other missing AWS services support.
11. 191.▲
    Understanding risks and avoiding FUD(unmitigatedrisk.com)

    2 points by hrez 11y ago|0 comments
12. 192.▲
    by hrez 11y ago

    AWS doesn't have that many OS versions. Besides I'd expect huge datasets go either to S3 or to ephemeral storage like Cassandra clusters etc. EBS isn't the best place for it. Your mileage may vary etc.
13. 193.▲
    by hrez 11y ago

    As example purestorage.com is all ssd storage with inline compression/dedupe and quotes 5-10x reduction on VM's.
14. 194.▲
    by hrez 11y ago

    Thanks. I'd guess bigger RAM uses bigger instance types as a host hence more bandwidth. If this was my goal I'd try gof3r to stream data from s3.
15. 195.▲
    by hrez 11y ago

    I meant http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/vpc-en... It's a private connection to AWS services including S3. You'd use the same URL as it's a routing basically. No idea if VP
16. 196.▲
    by hrez 11y ago

    Good point for "enchanced networking" instances. I didn't see OS specified in the article. AMZN linux would have SR-IOV driver by default. PV vs HVM might also have an impact.
17. 197.▲
    by hrez 11y ago

    Any comments on how it worked out with Lambda?
18. 198.▲
    by hrez 11y ago

    What missing from description is network setup. Is it ec2 classic, VPC? Is ec2 getting to s3 through IG? Hopefully not through NAT. There is also VPC endpoint to s3. Which all may have different performance profiles especially with multiple
19. 199.▲
    by hrez 11y ago

    Excellent https://github.com/rlmcpherson/s3gof3r is my tool of choice for "fast, parallelized, pipelined streaming access to Amazon S3." If you want to saturate network bandwidth with S3 that's the one t
20. 200.▲
    by hrez 11y ago

    IAM roles is ok as long as you realize that anything and anybody on that instance gets access to those credentials.
21. 201.▲
    by hrez 11y ago

    Or running Reserved instead of onDemand. It's all about use cases.
22. 202.▲
    by hrez 11y ago

    What makes it expensive for any significant traffic is "data processing" fee. But for S3 alone you can get away without NAT by using VPC endpoint.
23. 203.▲
    by hrez 11y ago

    So it's very similar to VPC Internet Gateway, only with upcharge of $0.045/Gb on traffic.
24. 204.▲
    by hrez 11y ago

    This bumps already expensive network by $0.045/Gb. It's not clear but may also add that to ingress traffic as well which otherwise would be free.
25. 205.▲
    by hrez 11y ago

    Besides being poor choice it also costs more. I.e. c4.4xlarge linux $7726.320 annually. c4.4xlarge windows $13542.960 annually. What are you wasting $5.8k for?
26. 206.▲
    by hrez 11y ago

    Really? How? My bzip2 has no option for it and when tested it stuck to one CPU. xz on the other hand has -T, --threads=NUM use at most NUM threads; the default is 1; set to 0 to use the number of processor cores
27. 207.▲
    by hrez 11y ago

    FWIW Cloudwatch has logs service.
28. 208.▲
    by hrez 11y ago

    Given you had to "meet at least the following requirements: It should recover from known AWS failure scenarios It should never lose our data It should be trivial to bring back to a known working state" How exactly are you go
29. 209.▲
    by hrez 11y ago

    Speaking of Google's shipping containers. Sun had that too- https://en.wikipedia.org/wiki/Sun_Modular_Datacenter "A data center of up to 280 servers can be rapidly deployed by shipping the container"
30. 210.▲
    by hrez 11y ago

    Washable keyboard http://www.amazon.com/Logitech-Washable-Keyboard-K310-Window...