5 ms·

Because it's next to free (no additional cost to run the infrastructure we're already running) and we're nowhere near the limits of our existing infrastructure'

Because it's next to free (no additional cost to run the infrastructure we're already running) and we're nowhere near the limits of our existing infrastructure's overall bandwidth limits right now, as evidenced by the lack of caps not affecting quality of internet service for the entirety of 2020, when more people were online per hour than at any previous point in history.

endisneigh 3y ago
Source? Running things requires labor, labor is getting expensive. Pricing isn’t set on simply the marginal cost of materials…
- vorpalhex 3y ago
  Running a fully utilized fiber line is.. exactly the same amount of labor as running a 10% utilized one. The cost to track and bill people for caps and let them pay overages though..
  - toomuchtodo 3y ago
    Chokepoints are peering exchanges, transit handoffs, and core network gear, which is sized for a percentile of utilization below constant 100%. Having implemented a billing system and utilization monitoring for managed hosting datacenter environment, it is trivial to collect metrics from equipment and bill accordingly. You don't want to nickle and dime or gouge customers, but you do want to ensure proportionality across the customer population. Some combination of caps, overage charges, traffic shaping, and edge CDN appliances is needed (Netflix, Akamai, etc). Off peak unlimited is also a potential strategy to drive low priority transfer to low utilization periods. Pick your poison. There is a reason most of Netflix global infra is monster CDN boxes closest to customers. https://openconnect.netflix.com/en/ https://openconnect.netflix.com/en/
    - throitallaway 3y ago
      > There is a reason most of Netflix global infra is monster CDN boxes closest to customers. Because it would be ridiculously expensive to egress video streams directly from AWS. They've determined that it's cheaper to pay ISPs for rack space.
      - toomuchtodo 3y ago
        You misunderstand the model. They don't pay ISPs, they offer the appliance for free to the ISP for colocation, reducing the upstream networking costs. AWS egress being extortionate is a distinct issue. The cost to the ISP in the rack (cooling, power, space) is immaterial considering the transfer savings (not only opex, but reduced capex from needing to oversize network gear or specific ports for peak streaming consumption) over the life of the relationship. If you want to learn more, lurk on the NANOG (North American Network Operators' Group) mailing list. It is common to monitor AS traffic flows to understand whether you can offload with CDN appliance relationships or how to improve your network architecture (which networks to peer to directly or which internet exchanges [IXs] to meetup at). These agreements sometimes happen at a bar over beers during NANOG events. Call Verizon and ask them how much a 1Gbps circuit is. Consider why Comcast built their own national backbone. Also, some important history to remember. Fast.com measures your speeds to Netflix servers because some ISPs wanted to charge their customers and Netflix for that transfer (or to upgrade peering points) because of the revenue destruction from cable customers fleeing for streaming (net neutrality debate). https://archive.nanog.org/meetings/nanog45/presentations/Norton_Peering101_v0_N45.pdf https://archive.nanog.org/meetings/nanog45/presentations/Nor... (Peering 101, Bill Norton [Equinix cofounder], NANOG 45) https://drpeering.net/white-papers/Video-Internet-The-Next-Wave-Of-Massive-Disruption-To-The-U.S.-Peering-Ecosystem.html https://drpeering.net/white-papers/Video-Internet-The-Next-W... (Video Internet: The Next Wave of Massive Disruption to the U.S. Peering Ecosystem (v1.7)) https://drpeering.net/HTML_IPP/ipptoc.html https://drpeering.net/HTML_IPP/ipptoc.html ("The Internet Peering Playbook") https://arstechnica.com/features/2008/09/peering-and-transit/ https://arstechnica.com/features/2008/09/peering-and-transit... ("How the ‘Net works: an introduction to peering and transit") https://arstechnica.com/information-technology/2014/07/how-comcast-became-a-powerful-and-controversial-part-of-the-internet-backbone/ https://arstechnica.com/information-technology/2014/07/how-c... ("How Comcast became a powerful—and controversial—part of the Internet backbone") https://openconnect.zendesk.com/hc/en-us/articles/360036163652-How-much-does-the-appliance-cost-my-organization- https://openconnect.zendesk.com/hc/en-us/articles/3600361636... > How much does the appliance cost my organization? > Appliances, including replacement appliances, are provided to qualifying ISPs at no charge when used within the terms of the license agreements.
atomicnumber3 3y ago
Also, when caps are implemented, they're ridiculously expensive and limited, especially in an age of streaming video. Expensive comically beyond any reasonable conception of the actual marginal cost of transiting the traffic. Also - just look at LTE operators. They're also no-cap at this point (though subject to QoS at certain breakpoints, but they're typically reasonable breakpoints ime?). And that's in a SIGNIFICANTLY more capital intensive market - you have most of the concerns with terrestrial fiber, plus the joy of having to own RF spectrum and maintain towers etc. So I think no-caps-and-required-speed requirements would just make sense and be required to keep ISPs from trying to backtrack on being forcibly dragged into the modern area like balky calves.
- Szpadel 3y ago
  I think that the issue is lack of competition. on mobile market it's easy to switch operator to any from multiple nation wide ones. for cable ISP AFAIK in US there is usually one. (in my central european country there is at least 3 ISP available ans AFAIK fibers to building are in some way rented to internet providers (?))
wongarsu 3y ago
In principle caps help with oversubscribing. If you want to use a 10GBit/s uplink to serve 5000 people with 100MBit/s each, you won't saturate your uplink nearly as often if you add a data cap. Of course that's not all that different from restricting bandwidth, just that you are restricting average bandwidth while allowing for some burst. Still violates the spirit of having fast bandwidth, unless the caps are quite generous.
- NotSammyHagar 3y ago
  They do help push people to use less, but for places like Comcast I see data caps as just a revenue stream increaser. The entire company strategy seems to follow this approach.
I_Am_Nous 3y ago
Yes and no, depending on your plant build out you might have great interplant connectivity - 10G between each switch, 10G to the router, but the extraplant connections still cost and have bandwidth limits. So if you only use 2 gbps total during peak, you may not need to upgrade your plant to support higher speeds but you will have to pay more to your upstream provider to support it. This is actually relevant to my ISP day job, we have a pipe to a well known backbone provider, and dual pipes to a statewide provider. We ran on the dual pipes for a long time before pushing our ISP traffic over the single backbone provider. These days, if that main ISP pipe goes down, it fails over to the dual pipes to keep everything running. But now that we are offering packages higher than 25/3 for DSL, terrestrial wireless, and cable, the dual pipes don't have enough bandwidth to keep up. If we offer gigabit service over fiber (and we do) just a couple of customers actively using their whole pipe is an enormous chunk of the network compared to the 40 or so customers that same gigabit of bandwidth would serve on previous 25/3 packages. We don't have data caps or even contracts (small town benefits :P ) but there is a lot more to it for smaller ISPs than adjusting the rate limiting and packages we allow people to use.
- musha68k 3y ago
  It’s true that smaller ISPs have their challenges, but the cost for both interplant and extraplant connections has been generally decreasing. Economies of scale and peering agreements can mitigate many of these costs.
  - I_Am_Nous 3y ago
    True, we connect our main ISP pipe to an internet exchange for that reason. It's also interesting to see how the industry is adopting pluggables for a lot of newer deployments because depending on what you need, there's a lot of flexibility now compared to even 5 years ago.
Sohcahtoa82 3y ago
> Because it's next to free (no additional cost to run the infrastructure we're already running) Aren't we effectively arguing CapEx versus OpEx? Sure, an ISP's OpEx is tiny. But CapEx is huge, especially when you've got an old neighborhood that's all wired up with copper and you gotta replace it all with fiber going into the house.

endisneigh 3y ago

Source? Running things requires labor, labor is getting expensive. Pricing isn’t set on simply the marginal cost of materials…

vorpalhex 3y ago
Running a fully utilized fiber line is.. exactly the same amount of labor as running a 10% utilized one. The cost to track and bill people for caps and let them pay overages though..
- toomuchtodo 3y ago
  Chokepoints are peering exchanges, transit handoffs, and core network gear, which is sized for a percentile of utilization below constant 100%. Having implemented a billing system and utilization monitoring for managed hosting datacenter environment, it is trivial to collect metrics from equipment and bill accordingly. You don't want to nickle and dime or gouge customers, but you do want to ensure proportionality across the customer population. Some combination of caps, overage charges, traffic shaping, and edge CDN appliances is needed (Netflix, Akamai, etc). Off peak unlimited is also a potential strategy to drive low priority transfer to low utilization periods. Pick your poison. There is a reason most of Netflix global infra is monster CDN boxes closest to customers. https://openconnect.netflix.com/en/ https://openconnect.netflix.com/en/
  - throitallaway 3y ago
    > There is a reason most of Netflix global infra is monster CDN boxes closest to customers. Because it would be ridiculously expensive to egress video streams directly from AWS. They've determined that it's cheaper to pay ISPs for rack space.
    - toomuchtodo 3y ago
      You misunderstand the model. They don't pay ISPs, they offer the appliance for free to the ISP for colocation, reducing the upstream networking costs. AWS egress being extortionate is a distinct issue. The cost to the ISP in the rack (cooling, power, space) is immaterial considering the transfer savings (not only opex, but reduced capex from needing to oversize network gear or specific ports for peak streaming consumption) over the life of the relationship. If you want to learn more, lurk on the NANOG (North American Network Operators' Group) mailing list. It is common to monitor AS traffic flows to understand whether you can offload with CDN appliance relationships or how to improve your network architecture (which networks to peer to directly or which internet exchanges [IXs] to meetup at). These agreements sometimes happen at a bar over beers during NANOG events. Call Verizon and ask them how much a 1Gbps circuit is. Consider why Comcast built their own national backbone. Also, some important history to remember. Fast.com measures your speeds to Netflix servers because some ISPs wanted to charge their customers and Netflix for that transfer (or to upgrade peering points) because of the revenue destruction from cable customers fleeing for streaming (net neutrality debate). https://archive.nanog.org/meetings/nanog45/presentations/Norton_Peering101_v0_N45.pdf https://archive.nanog.org/meetings/nanog45/presentations/Nor... (Peering 101, Bill Norton [Equinix cofounder], NANOG 45) https://drpeering.net/white-papers/Video-Internet-The-Next-Wave-Of-Massive-Disruption-To-The-U.S.-Peering-Ecosystem.html https://drpeering.net/white-papers/Video-Internet-The-Next-W... (Video Internet: The Next Wave of Massive Disruption to the U.S. Peering Ecosystem (v1.7)) https://drpeering.net/HTML_IPP/ipptoc.html https://drpeering.net/HTML_IPP/ipptoc.html ("The Internet Peering Playbook") https://arstechnica.com/features/2008/09/peering-and-transit/ https://arstechnica.com/features/2008/09/peering-and-transit... ("How the ‘Net works: an introduction to peering and transit") https://arstechnica.com/information-technology/2014/07/how-comcast-became-a-powerful-and-controversial-part-of-the-internet-backbone/ https://arstechnica.com/information-technology/2014/07/how-c... ("How Comcast became a powerful—and controversial—part of the Internet backbone") https://openconnect.zendesk.com/hc/en-us/articles/360036163652-How-much-does-the-appliance-cost-my-organization- https://openconnect.zendesk.com/hc/en-us/articles/3600361636... > How much does the appliance cost my organization? > Appliances, including replacement appliances, are provided to qualifying ISPs at no charge when used within the terms of the license agreements.

atomicnumber3 3y ago

Also, when caps are implemented, they're ridiculously expensive and limited, especially in an age of streaming video. Expensive comically beyond any reasonable conception of the actual marginal cost of transiting the traffic. Also - just look at LTE operators. They're also no-cap at this point (though subject to QoS at certain breakpoints, but they're typically reasonable breakpoints ime?). And that's in a SIGNIFICANTLY more capital intensive market - you have most of the concerns with terrestrial fiber, plus the joy of having to own RF spectrum and maintain towers etc. So I think no-caps-and-required-speed requirements would just make sense and be required to keep ISPs from trying to backtrack on being forcibly dragged into the modern area like balky calves.

Szpadel 3y ago
I think that the issue is lack of competition. on mobile market it's easy to switch operator to any from multiple nation wide ones. for cable ISP AFAIK in US there is usually one. (in my central european country there is at least 3 ISP available ans AFAIK fibers to building are in some way rented to internet providers (?))

wongarsu 3y ago

In principle caps help with oversubscribing. If you want to use a 10GBit/s uplink to serve 5000 people with 100MBit/s each, you won't saturate your uplink nearly as often if you add a data cap. Of course that's not all that different from restricting bandwidth, just that you are restricting average bandwidth while allowing for some burst. Still violates the spirit of having fast bandwidth, unless the caps are quite generous.

NotSammyHagar 3y ago
They do help push people to use less, but for places like Comcast I see data caps as just a revenue stream increaser. The entire company strategy seems to follow this approach.

I_Am_Nous 3y ago

Yes and no, depending on your plant build out you might have great interplant connectivity - 10G between each switch, 10G to the router, but the extraplant connections still cost and have bandwidth limits. So if you only use 2 gbps total during peak, you may not need to upgrade your plant to support higher speeds but you will have to pay more to your upstream provider to support it. This is actually relevant to my ISP day job, we have a pipe to a well known backbone provider, and dual pipes to a statewide provider. We ran on the dual pipes for a long time before pushing our ISP traffic over the single backbone provider. These days, if that main ISP pipe goes down, it fails over to the dual pipes to keep everything running. But now that we are offering packages higher than 25/3 for DSL, terrestrial wireless, and cable, the dual pipes don't have enough bandwidth to keep up. If we offer gigabit service over fiber (and we do) just a couple of customers actively using their whole pipe is an enormous chunk of the network compared to the 40 or so customers that same gigabit of bandwidth would serve on previous 25/3 packages. We don't have data caps or even contracts (small town benefits :P ) but there is a lot more to it for smaller ISPs than adjusting the rate limiting and packages we allow people to use.

musha68k 3y ago
It’s true that smaller ISPs have their challenges, but the cost for both interplant and extraplant connections has been generally decreasing. Economies of scale and peering agreements can mitigate many of these costs.
- I_Am_Nous 3y ago
  True, we connect our main ISP pipe to an internet exchange for that reason. It's also interesting to see how the industry is adopting pluggables for a lot of newer deployments because depending on what you need, there's a lot of flexibility now compared to even 5 years ago.

Sohcahtoa82 3y ago

> Because it's next to free (no additional cost to run the infrastructure we're already running) Aren't we effectively arguing CapEx versus OpEx? Sure, an ISP's OpEx is tiny. But CapEx is huge, especially when you've got an old neighborhood that's all wired up with copper and you gotta replace it all with fiber going into the house.