5 ms·

The thread is much more interesting than the initial tweet. https://threadreaderapp.com/thread/1102401615263223809.html https://threadreaderapp.com/thread/1102

by sisk 8y ago

The thread is much more interesting than the initial tweet. https://threadreaderapp.com/thread/1102401615263223809.html https://threadreaderapp.com/thread/1102401615263223809.html

draw_down 8y ago
The link shows the thread.
skilled 8y ago
Great app, didn't know it exists! Thank you. And if mods feel it's appropriate, then I don't mind if the link is swapped.
deleted 8y ago
[deleted]
altmind 8y ago
This thread only compares ROI of hosting in cloud with building own datacenter and laying own oceanic fiber(!!). The option of using a colo and magistral ISP somehow fell through the cracks. Of course building one datacenter and own oceanic fiber to host your own services is a bad option for almost every business - not every business can fill a full DC, and 1 DC is not enough to guarantee global operations.
- altmind 8y ago
  The orignal author mentioned how good AWS worked for netflix, but did not mention that netflix rolled their own content delivery system in part because of high traffic cost with all the major cloud providers.
  - snarf21 8y ago
    Exactly, AWS is perfect for running the search and UI features but you have to have the content at the edge or get killed on bandwidth.
  - kemitche 8y ago
    He did mention that about netflix: https://twitter.com/MohapatraHemant/status/1102410173203660800 https://twitter.com/MohapatraHemant/status/11024101732036608... > E.g. if you are +30% of the internet traffic (nflx) it doesn't make sense to pay rent to telcos any more and feed their margins. You have the volume and stable demand to justify ownership. For the rest, cloud is where they'll live and die.
  - drewg123 8y ago
    My understanding is that most commercial CDNs (Limelight, Akamai, etc) are also more cost-effective than serving directly from AWS. However, commercial CDNs don't know a-priori what files are going to be popular, and how to distribute them in different regions and on different types of storage to maximize efficiency. But that's one of the things that Netflix's CDN team can predict. See https://medium.com/netflix-techblog/distributing-content-to-open-connect-3e3e391d4dc9 https://medium.com/netflix-techblog/distributing-content-to-...
- isostatic 8y ago
  Hurricane Electric currently have a 42U cabinet and 1 gigabit of bandwidth for $400pcm. That's the cost of about 6 AWS t2.large VMs That's 50 cents per hour to colocate dozens of servers, and there's 324TB of data thrown in for free. Obviously you have the tin to buy and maintain which will cost you. Leasing costs for a typical HP server are say $100/month. 10G transit on it's own is around $2k/month with H.E, or 1 cent for 16GB if it's fully saturated.
  - Youden 8y ago
    > That's 50 cents per hour to colocate dozens of servers, and there's 324TB of data thrown in for free. That deal actually only includes 15A of power, which isn't enough to fill the cabinet if your machines aren't idle.
    - zaroth 8y ago
      And really it’s only 12amps! 120v! What the heck are you going to do with 42U and 1,440 watts?! I couldn’t believe it was a 15A circuit for the whole cabinet when I went there. This was several years ago but the other issue I had was DDoS against someone else there collaterally taking down our network. Ended up moving to 55 S Market in San Jose and have been very happy. Those racks are at least 40 amps.
      - isostatic 8y ago
        My bays tend to have 2x 32A provision, but we run grown up voltages in Europe.
- erik_seaberg 8y ago
  I've never heard the phrase "magistral ISP" and I can't make the connection to https://www.merriam-webster.com/dictionary/magisterial https://www.merriam-webster.com/dictionary/magisterial, could you explain that?
  - altmind 8y ago
    I meant backbone network provider. As to oppose to consumer ISP.
the8472 8y ago
The twitter desktop page shows the whole thread already.

by sisk 8y ago

The thread is much more interesting than the initial tweet. https://threadreaderapp.com/thread/1102401615263223809.html https://threadreaderapp.com/thread/1102401615263223809.html

draw_down 8y ago

The link shows the thread.

skilled 8y ago

Great app, didn't know it exists! Thank you. And if mods feel it's appropriate, then I don't mind if the link is swapped.

deleted 8y ago

[deleted]

altmind 8y ago

This thread only compares ROI of hosting in cloud with building own datacenter and laying own oceanic fiber(!!). The option of using a colo and magistral ISP somehow fell through the cracks. Of course building one datacenter and own oceanic fiber to host your own services is a bad option for almost every business - not every business can fill a full DC, and 1 DC is not enough to guarantee global operations.

altmind 8y ago
The orignal author mentioned how good AWS worked for netflix, but did not mention that netflix rolled their own content delivery system in part because of high traffic cost with all the major cloud providers.
- snarf21 8y ago
  Exactly, AWS is perfect for running the search and UI features but you have to have the content at the edge or get killed on bandwidth.
- kemitche 8y ago
  He did mention that about netflix: https://twitter.com/MohapatraHemant/status/1102410173203660800 https://twitter.com/MohapatraHemant/status/11024101732036608... > E.g. if you are +30% of the internet traffic (nflx) it doesn't make sense to pay rent to telcos any more and feed their margins. You have the volume and stable demand to justify ownership. For the rest, cloud is where they'll live and die.
- drewg123 8y ago
  My understanding is that most commercial CDNs (Limelight, Akamai, etc) are also more cost-effective than serving directly from AWS. However, commercial CDNs don't know a-priori what files are going to be popular, and how to distribute them in different regions and on different types of storage to maximize efficiency. But that's one of the things that Netflix's CDN team can predict. See https://medium.com/netflix-techblog/distributing-content-to-open-connect-3e3e391d4dc9 https://medium.com/netflix-techblog/distributing-content-to-...
isostatic 8y ago
Hurricane Electric currently have a 42U cabinet and 1 gigabit of bandwidth for $400pcm. That's the cost of about 6 AWS t2.large VMs That's 50 cents per hour to colocate dozens of servers, and there's 324TB of data thrown in for free. Obviously you have the tin to buy and maintain which will cost you. Leasing costs for a typical HP server are say $100/month. 10G transit on it's own is around $2k/month with H.E, or 1 cent for 16GB if it's fully saturated.
- Youden 8y ago
  > That's 50 cents per hour to colocate dozens of servers, and there's 324TB of data thrown in for free. That deal actually only includes 15A of power, which isn't enough to fill the cabinet if your machines aren't idle.
  - zaroth 8y ago
    And really it’s only 12amps! 120v! What the heck are you going to do with 42U and 1,440 watts?! I couldn’t believe it was a 15A circuit for the whole cabinet when I went there. This was several years ago but the other issue I had was DDoS against someone else there collaterally taking down our network. Ended up moving to 55 S Market in San Jose and have been very happy. Those racks are at least 40 amps.
    - isostatic 8y ago
      My bays tend to have 2x 32A provision, but we run grown up voltages in Europe.
erik_seaberg 8y ago
I've never heard the phrase "magistral ISP" and I can't make the connection to https://www.merriam-webster.com/dictionary/magisterial https://www.merriam-webster.com/dictionary/magisterial, could you explain that?
- altmind 8y ago
  I meant backbone network provider. As to oppose to consumer ISP.

the8472 8y ago

The twitter desktop page shows the whole thread already.