8 ms·

Cloudflare: 455 Mbps down / 73.1 Mbps up / Latency 13.0 ms / Jitter 2.26 ms / Server: Ashburn via IPv6. Netflix (fast.com): 790 Mbps down / 950 Mbps up / Laten

by js2 6y ago

Cloudflare: 455 Mbps down / 73.1 Mbps up / Latency 13.0 ms / Jitter 2.26 ms / Server: Ashburn via IPv6. Netflix (fast.com): 790 Mbps down / 950 Mbps up / Latency 8 ms unloaded, 12 ms loaded / Server: Ashburn via IPv6. Ookla (speedtest.net): 928 Mbps down / 938 Mbps up / Ping 1 ms / Server: Raleigh via IPv4. DSL Reports (http://www.dslreports.com/speedtest http://www.dslreports.com/speedtest): 611 Mbps down / 929 Mbps up / ping 16-41ms / Servers: Houston, Dallas, Newcastle DE, Nashville TN, Dallas. Location: Raleigh. Provider: AT&T fiber. Test run using Safari, macOS 10.15.4, Thunderbolt Ethernet. Edit: the small file sizes used for some of the tests seem to drag down the overall speed measurement quite a bit. It's biased against upload measurements too since there's download files sizes of 25MB and 100MB whereas upload tests only up to 10MB file size. But even there, something seems off. The upload measurements are much smaller for the same file sizes (e.g. 170 Mbps avg vs 7 Mbs average for a 10 kB file). I question this methodology. I care most about my 1Gps when I'm downloading the latest version of Xcode or some other huge file. I guess the smaller sizes are to better emulate downloading web pages, but in that case, the latency is probably what matters more. Even with 1Gps, when I'm out in CA, sites typically feel faster. Edit 2: speedtest.googlefiber.net: 800-900 Mbps down / 800-900 Mbps up (multiple tests to servers in Charlotte, Raleigh, Atlanta, seems to bounce around each time I reload the page). Speedtest (Ookla) with server manually set to Windstream in Ashburn, VA: 886 Mbps down, 900 Mbps up. Confirmed that my router is measuring the same amount, so Ookla isn't just making up these numbers.

kirktrue 6y ago
Now you're just showing off ;)
- popped 6y ago
  No I think this is important. Are they that wildly different from each other that they aren't that useful? Is one better than the rest?
cryptoquick 6y ago
I also have synchronous gigabit fiber, and I was surprised to get way different results from the others. They're similar to yours. Not sure if this is on CloudFlare's end, or if there's something on my end or my ISP's end.
- capableweb 6y ago
  Seeing the same so most likely on cloudflares side.
deleted 6y ago
[deleted]
sixhobbits 6y ago
Isn't this because Netflix (fast.com) has better peering agreements with most ISPs while Cloudflare relies more on their own infrastructure?
- nahname 6y ago
  Or the ISPs don't throttle traffic to fast.com
  - capableweb 6y ago
    That makes sense, think there been evidence of ISPs throttling connections, except for speedtests, in the past, so would make sense. My own ISP also used to throttle Steam downloads for a couple of years, until suddenly they didn't.
    - lucasmullens 6y ago
      I thought one of the goals of fast.com was to let users find out if their ISP is throttling Netflix. ISPs can't only throttle a speedtest if Netflix makes it indistinguishable.
      - capableweb 6y ago
        Maybe that is, but one can think of a number of ways for ISPs to work around that. Quick thought: if the ISP is also your DNS resolver (which is the default for most people), check if there been a query for fast.com and if so, stop the throttling for five minutes. After those minutes, start throttling again.
      - gonesilent 6y ago
        Not so, Viasat will throttle based on headers and even built helpers for speed tests that bypass other limits. Such as forced video resolution down grades.
  - deleted 6y ago
    [deleted]
karmakaze 6y ago
Cloudflare is reporting the p90 throughput of samples. Doubt the others are measuring this way.
- js2 6y ago
  Even the max rates reported under "Download Measurements" and "Upload Measurements" are slower than any other site I test against. The site also has a lot more variability from test to test. I get download measurements anywhere from 400-800 Mbps, but mostly under 500 Mbps. I have yet to see an upload measurement above 100 Mbps. This test just doesn't reflect real-world results for my Internet connection.
  - karmakaze 6y ago
    Not to discount anything you've said, but some speed tests I've run find a server that is so close to me that it's not really testing 'Internet speed' as it is just the speed of my ISP and maybe another. I don't know what people want from speed tests and it's good to have different ones, just know what you're measuring. I'm not a low-latency gamer so none of the differences really matter unless they're near zero. I've been streaming video and fetching/pushing git repos that I use since having a 5Mbps connection.
deleted 6y ago
[deleted]
yxhuvud 6y ago
For me I get roughly the same download speed as the normal measurements (875Mbps), but upload is more than halved (423Mbps) compared to what other tests report (tests that I have more faith in, like bredbandskollen.se which is reputed to be very good for Swedish connections).
arghwhat 6y ago
Note: ISPs provide speedtest.net servers themselves, so that never leaves the ISP and only tests the link to them. fast.com likely has the exact same issue, as Netflix has content boxes at ISPs, although I can't say for sure. Plus, even then, "speed" isn't absolute. It's all about agreements, routes, capacities and load. Test to specific targets of interest if you can, e.g. http://speedtest-nyc1.digitalocean.com/ http://speedtest-nyc1.digitalocean.com/.
- js2 6y ago
  It depends what you want to measure of course. I provided results to a variety of servers besides my local fast.com and speedtest.net server. As well, I'm familiar with what speeds I get when downloading Xcode, when pulling binaries via Usenet, etc. The results from Cloudflare indicate to me a bottleneck on their end, and something is especially wonky with the upload result. I get 860-910 Mbps down/ 180-372 Mbps up to NYC[1-3], TOR1, but I have to test using Chrome. Running the DO test under Safari is pegging the CPU on a Macbook Pro 2.7 Ghz i7. (The other speed tests run fine under Safari.)
  - arghwhat 6y ago
    Indeed, their tests are currently wonky. I get 10% of my regular upload capacity, and 30-50% of my download through their test, despite testing to a Cloudflare location within the same city as myself. I just wanted to ensure that we correctly discredited useless numbers and focused on the interesting ones instead.
- EE84M3i 6y ago
  Doesn't cloudflare also have boxes in ISPs? Youtube, Netflix, Facebook, Akamai, Cloudfront, etc all do. It's all relative.
  - arghwhat 6y ago
    Do they? In that case, this metric is also pretty useless. Unless your only interest is an internal network with your ISP.
leihca 6y ago
Thanks for the feedback, very much appreciated! I'm a product manager here at Cloudflare, responsible for launching this tool. Since the launch, we've found some issues that we're going to address: - Especially for users with a very fast Internet connection, speed.cloudflare.com reports upload speeds much lower than expected figures. We don't yet know what is causing this but will disable the upload part of the test until we know more. - In general reported download speeds are little lower than figures coming from other speed tests. We will revisit our methodology to understand the discrepancy. - Re: the speed test automatically starting: we appreciate the feedback and understand why some users may not want this as default behavior. We will disable the auto-start for now. In the meantime, we appreciate any and all feedback, please keep it coming: you can reach me at achiel [at] cloudflare.com
- bitcoinrelay 6y ago
  For Bitcoin, we run a open source relay network called FIBRE, and incredibly low latency network which uses some encoding tricks to gain significantly faster than TCP transmission of block data around the world. It's currently limited in part by the number of points of presence that can be reasonably operated from. Is there anybody at Cloudflare that would be interested in taking this on using your incredibly latency-diverse network?
- hellcow 6y ago
  > - In general reported download speeds are little lower than figures coming from other speed tests. We will revisit our methodology to understand the discrepancy. For what it's worth, Cloudflare shows me at 10mbps down, and Speedtest shows me at 160mbps (much closer to my expected 200mbps). This is a large difference.
  - jgrahamc 6y ago
    Yes, that is. Want to drop me email (jgc @ cloudflare . com) with details?
- jedberg 6y ago
  I came here to make all the same feedback. My 1Gbps connection also massively under-reports.
jorams 6y ago
Interestingly, for me, it's reporting significantly higher speeds than I'm paying for, and than other speed tests report. I'm paying for 100 Mbps down / 100 Mbps up, and every speedtest always comes very close. Upload usually a little higher. From experience the actual maximum speed is also roughly 12 to 13 MBps. Cloudflare is reporting 667 Mbps down / 220 Mbps up.
- byproxy 6y ago
  It's also showing higher speeds, for me. Though only ~20Mbps higher on Cloudfare's speed test vs. other speed tests (and what I'm paying for).
- Sami_Lehtinen 6y ago
  It depends how it's tested. Clearly short burst test produces high numbers, because it gets really high, before traffic shaping (throttling) kicks in. In my case cloudflare reports almost 10x the speed I'm actually getting for prolonged downloads. Of course burst speed is much higher.
xoogler231 6y ago
Netflix has servers directly in the ISP datacenter. Ookla also is generally run out of the isp datacenter. Cloudflare has servers running at a PoP and doesn’t get the same performance
Youden 6y ago
You might know this but in case others don't, seeing different speed test results to different services/servers is completely normal. A lot of people forget or don't understand the "net" part of "internet". The internet isn't a monolithic service you connect to. When your ISP offers you "1Gbps" internet, they're not guaranteeing that whatever your activity, you will get 1Gbps, they're just giving you a 1Gbps connection to their network. Their network will then interconnect with other networks. Depending on the specifics of those interconnections, you will see different performance characteristics depending on what you're doing. For example my ISP peers with a particular network that hosts servers ~600km away that I exchange a ton of data with. I get 1Gbps when I use my ISP. However when I use a different local ISP that doesn't peer with the remote network, I see significantly reduced speeds, because the route taken to exchange data isn't optimal. I know the HN crowd is fairly technically competent but I've seen plenty of competent people who I think knew this in an abstract sense but it just hadn't clicked for them what the practical consequences were.
FridgeSeal 6y ago
Meanwhile in a major city in Australia: 44 Mbps down 30ms latency 12.5 ms jitter What’s it like having internet that actually goes?
- firecall 6y ago
  Meanwhile in a minor town in Australia: 26.9 Mbps down 11.4ms latency 1.96ms jitter What’s it like having internet that actually goes? (my synch speed is only 24.73 Mbps, so those numbers dont seem right...)
  - fphhotchips 6y ago
    Come on guys, 25mbps is enough for like 4 SD Foxtel streams. That's enough for anyone. -- Tony Abbott, probably.
- dubya 6y ago
  Luxury! 33.4 Mbps down 22.5 ms latency 8.5 ms jitter in a medium city in Tennessee, USA. Paying for up to 100 Mbps, but ~35 is consistent across times and sites.
  - dubya 6y ago
    Follow-up: 33.4 was because I'm an idiot. I have a surge suppressor with coax in/out between the wall and my modem (lost a cable modem, router and networked laser printer to lightning a few years ago). Removing it puts me at 103/23.0/4.53. I'm sure I checked after adding the surge suppressor, but not, apparently, in quite a long time.
- terrywang 6y ago
  Metropolitan Sydney (upload is temporarily disabled) Paying A$89 for TPG 100Mbps plan Server location: Sydney Down 93.6Mbps Latency: 14.9ms Jitter: 4.97ms Before students went back to school, upload bandwidth was throttled at 4~8Mbps (due to the congestion caused by nation wide WFH), now speedtest / fast.com reports 30~40Mbps... Surprisingly, download bandwidth has not been affected like Optus Cable before (experienced 10Mbps or less for 100Mbps/2Mbps plan), facepalm.
spullara 6y ago
These are just like the results I get for 1Gbit comcast here in the bay area for the various services.
rckoepke 6y ago
I strongly prefer google's speedtest[0] as it's run through M-Labs (Measurement Labs). This group originally gained prominence doing distributed testing of ISP's to determine if they were blocking specific types of traffic (torrents, etc) I think 15 years ago or so. M-Labs for me has the highest real-world accuracy, because it's designed to obfuscate the testing servers so that your ISP can't cheat or make itself look better by prioritizing M-Labs servers. 0: https://www.google.com/search?q=speedtest https://www.google.com/search?q=speedtest

by js2 6y ago

kirktrue 6y ago

Now you're just showing off ;)

popped 6y ago
No I think this is important. Are they that wildly different from each other that they aren't that useful? Is one better than the rest?

cryptoquick 6y ago

I also have synchronous gigabit fiber, and I was surprised to get way different results from the others. They're similar to yours. Not sure if this is on CloudFlare's end, or if there's something on my end or my ISP's end.

capableweb 6y ago
Seeing the same so most likely on cloudflares side.

deleted 6y ago

[deleted]

sixhobbits 6y ago

Isn't this because Netflix (fast.com) has better peering agreements with most ISPs while Cloudflare relies more on their own infrastructure?

nahname 6y ago
Or the ISPs don't throttle traffic to fast.com
- capableweb 6y ago
  That makes sense, think there been evidence of ISPs throttling connections, except for speedtests, in the past, so would make sense. My own ISP also used to throttle Steam downloads for a couple of years, until suddenly they didn't.
  - lucasmullens 6y ago
    I thought one of the goals of fast.com was to let users find out if their ISP is throttling Netflix. ISPs can't only throttle a speedtest if Netflix makes it indistinguishable.
    - capableweb 6y ago
      Maybe that is, but one can think of a number of ways for ISPs to work around that. Quick thought: if the ISP is also your DNS resolver (which is the default for most people), check if there been a query for fast.com and if so, stop the throttling for five minutes. After those minutes, start throttling again.
    - gonesilent 6y ago
      Not so, Viasat will throttle based on headers and even built helpers for speed tests that bypass other limits. Such as forced video resolution down grades.
- deleted 6y ago
  [deleted]

karmakaze 6y ago

Cloudflare is reporting the p90 throughput of samples. Doubt the others are measuring this way.

js2 6y ago
Even the max rates reported under "Download Measurements" and "Upload Measurements" are slower than any other site I test against. The site also has a lot more variability from test to test. I get download measurements anywhere from 400-800 Mbps, but mostly under 500 Mbps. I have yet to see an upload measurement above 100 Mbps. This test just doesn't reflect real-world results for my Internet connection.
- karmakaze 6y ago
  Not to discount anything you've said, but some speed tests I've run find a server that is so close to me that it's not really testing 'Internet speed' as it is just the speed of my ISP and maybe another. I don't know what people want from speed tests and it's good to have different ones, just know what you're measuring. I'm not a low-latency gamer so none of the differences really matter unless they're near zero. I've been streaming video and fetching/pushing git repos that I use since having a 5Mbps connection.

deleted 6y ago

[deleted]

yxhuvud 6y ago

For me I get roughly the same download speed as the normal measurements (875Mbps), but upload is more than halved (423Mbps) compared to what other tests report (tests that I have more faith in, like bredbandskollen.se which is reputed to be very good for Swedish connections).

arghwhat 6y ago

Note: ISPs provide speedtest.net servers themselves, so that never leaves the ISP and only tests the link to them. fast.com likely has the exact same issue, as Netflix has content boxes at ISPs, although I can't say for sure. Plus, even then, "speed" isn't absolute. It's all about agreements, routes, capacities and load. Test to specific targets of interest if you can, e.g. http://speedtest-nyc1.digitalocean.com/ http://speedtest-nyc1.digitalocean.com/.

js2 6y ago
It depends what you want to measure of course. I provided results to a variety of servers besides my local fast.com and speedtest.net server. As well, I'm familiar with what speeds I get when downloading Xcode, when pulling binaries via Usenet, etc. The results from Cloudflare indicate to me a bottleneck on their end, and something is especially wonky with the upload result. I get 860-910 Mbps down/ 180-372 Mbps up to NYC[1-3], TOR1, but I have to test using Chrome. Running the DO test under Safari is pegging the CPU on a Macbook Pro 2.7 Ghz i7. (The other speed tests run fine under Safari.)
- arghwhat 6y ago
  Indeed, their tests are currently wonky. I get 10% of my regular upload capacity, and 30-50% of my download through their test, despite testing to a Cloudflare location within the same city as myself. I just wanted to ensure that we correctly discredited useless numbers and focused on the interesting ones instead.
EE84M3i 6y ago
Doesn't cloudflare also have boxes in ISPs? Youtube, Netflix, Facebook, Akamai, Cloudfront, etc all do. It's all relative.
- arghwhat 6y ago
  Do they? In that case, this metric is also pretty useless. Unless your only interest is an internal network with your ISP.

leihca 6y ago

Thanks for the feedback, very much appreciated! I'm a product manager here at Cloudflare, responsible for launching this tool. Since the launch, we've found some issues that we're going to address: - Especially for users with a very fast Internet connection, speed.cloudflare.com reports upload speeds much lower than expected figures. We don't yet know what is causing this but will disable the upload part of the test until we know more. - In general reported download speeds are little lower than figures coming from other speed tests. We will revisit our methodology to understand the discrepancy. - Re: the speed test automatically starting: we appreciate the feedback and understand why some users may not want this as default behavior. We will disable the auto-start for now. In the meantime, we appreciate any and all feedback, please keep it coming: you can reach me at achiel [at] cloudflare.com

bitcoinrelay 6y ago
For Bitcoin, we run a open source relay network called FIBRE, and incredibly low latency network which uses some encoding tricks to gain significantly faster than TCP transmission of block data around the world. It's currently limited in part by the number of points of presence that can be reasonably operated from. Is there anybody at Cloudflare that would be interested in taking this on using your incredibly latency-diverse network?
hellcow 6y ago
> - In general reported download speeds are little lower than figures coming from other speed tests. We will revisit our methodology to understand the discrepancy. For what it's worth, Cloudflare shows me at 10mbps down, and Speedtest shows me at 160mbps (much closer to my expected 200mbps). This is a large difference.
- jgrahamc 6y ago
  Yes, that is. Want to drop me email (jgc @ cloudflare . com) with details?
jedberg 6y ago
I came here to make all the same feedback. My 1Gbps connection also massively under-reports.

jorams 6y ago

Interestingly, for me, it's reporting significantly higher speeds than I'm paying for, and than other speed tests report. I'm paying for 100 Mbps down / 100 Mbps up, and every speedtest always comes very close. Upload usually a little higher. From experience the actual maximum speed is also roughly 12 to 13 MBps. Cloudflare is reporting 667 Mbps down / 220 Mbps up.

byproxy 6y ago
It's also showing higher speeds, for me. Though only ~20Mbps higher on Cloudfare's speed test vs. other speed tests (and what I'm paying for).
Sami_Lehtinen 6y ago
It depends how it's tested. Clearly short burst test produces high numbers, because it gets really high, before traffic shaping (throttling) kicks in. In my case cloudflare reports almost 10x the speed I'm actually getting for prolonged downloads. Of course burst speed is much higher.

xoogler231 6y ago

Netflix has servers directly in the ISP datacenter. Ookla also is generally run out of the isp datacenter. Cloudflare has servers running at a PoP and doesn’t get the same performance

Youden 6y ago

You might know this but in case others don't, seeing different speed test results to different services/servers is completely normal. A lot of people forget or don't understand the "net" part of "internet". The internet isn't a monolithic service you connect to. When your ISP offers you "1Gbps" internet, they're not guaranteeing that whatever your activity, you will get 1Gbps, they're just giving you a 1Gbps connection to their network. Their network will then interconnect with other networks. Depending on the specifics of those interconnections, you will see different performance characteristics depending on what you're doing. For example my ISP peers with a particular network that hosts servers ~600km away that I exchange a ton of data with. I get 1Gbps when I use my ISP. However when I use a different local ISP that doesn't peer with the remote network, I see significantly reduced speeds, because the route taken to exchange data isn't optimal. I know the HN crowd is fairly technically competent but I've seen plenty of competent people who I think knew this in an abstract sense but it just hadn't clicked for them what the practical consequences were.

FridgeSeal 6y ago

Meanwhile in a major city in Australia: 44 Mbps down 30ms latency 12.5 ms jitter What’s it like having internet that actually goes?

firecall 6y ago
Meanwhile in a minor town in Australia: 26.9 Mbps down 11.4ms latency 1.96ms jitter What’s it like having internet that actually goes? (my synch speed is only 24.73 Mbps, so those numbers dont seem right...)
- fphhotchips 6y ago
  Come on guys, 25mbps is enough for like 4 SD Foxtel streams. That's enough for anyone. -- Tony Abbott, probably.
dubya 6y ago
Luxury! 33.4 Mbps down 22.5 ms latency 8.5 ms jitter in a medium city in Tennessee, USA. Paying for up to 100 Mbps, but ~35 is consistent across times and sites.
- dubya 6y ago
  Follow-up: 33.4 was because I'm an idiot. I have a surge suppressor with coax in/out between the wall and my modem (lost a cable modem, router and networked laser printer to lightning a few years ago). Removing it puts me at 103/23.0/4.53. I'm sure I checked after adding the surge suppressor, but not, apparently, in quite a long time.
terrywang 6y ago
Metropolitan Sydney (upload is temporarily disabled) Paying A$89 for TPG 100Mbps plan Server location: Sydney Down 93.6Mbps Latency: 14.9ms Jitter: 4.97ms Before students went back to school, upload bandwidth was throttled at 4~8Mbps (due to the congestion caused by nation wide WFH), now speedtest / fast.com reports 30~40Mbps... Surprisingly, download bandwidth has not been affected like Optus Cable before (experienced 10Mbps or less for 100Mbps/2Mbps plan), facepalm.

spullara 6y ago

These are just like the results I get for 1Gbit comcast here in the bay area for the various services.

rckoepke 6y ago

I strongly prefer google's speedtest[0] as it's run through M-Labs (Measurement Labs). This group originally gained prominence doing distributed testing of ISP's to determine if they were blocking specific types of traffic (torrents, etc) I think 15 years ago or so. M-Labs for me has the highest real-world accuracy, because it's designed to obfuscate the testing servers so that your ISP can't cheat or make itself look better by prioritizing M-Labs servers. 0: https://www.google.com/search?q=speedtest https://www.google.com/search?q=speedtest