4 ms·

I see that site is maintained by SourceHut though - are the test run from within their own DC? That could contribute to the performance score.

by odensc 6y ago

battery_cowboy 6y ago
No, they do it in a fair way, I believe if you read the page it will tell you how they fairly measure performance between the forges. Edit: see "Expand for details on methodology" right at the top of the page.
- odensc 6y ago
  Yes, that explains their methodology but not the location of the hardware. If I go and run a Lighthouse audit on localhost vs. a server in Philadelphia there's going to be an inherent difference.
  - jraph 6y ago
    I remember reading that they also ran the benchmark in Germany and got similar results when first reading about this here on hn. Anyway, it suffice to use gitlab, github, bitbucket and sourcehub for a few seconds to notice the slowness of the three first sites compared to the last one. We didn't really need the numbers to be convinced but I hope they will produce some pressure to be faster.
  - battery_cowboy 6y ago
    Sorry, I seemed to remember they did something to make it fair, I don't recall the location. I use sr.ht and I've used the others and, for me, it feels like 'turbo mode' compared to them. Especially git pushing: it's faster than pushing to my dokku server that only I use!
cosmojg 6y ago
Very true. I'm in a different part of the country (I'm in Boston, they're in Philadelphia) and tried running the benchmarks myself about a week ago. Unfortunately, I didn't save the results, but if you take my word for it, I remember getting similar results with only slightly different numbers. Your best bet, of course, is to run the benchmarks yourself: https://git.sr.ht/~sircmpwn/forgeperf https://git.sr.ht/~sircmpwn/forgeperf Some other people ran the benchmarks from different places in Europe and got similar results with "nothing significantly different" from those published: https://news.ycombinator.com/item?id=22900649 https://news.ycombinator.com/item?id=22900649
- odensc 6y ago
  I'll try it out later today. Would be interesting to see actually because, completely anecdotally, GitLab seems faster than sr.ht in my daily usage.
  - cosmojg 6y ago
    Don't make the same mistake that I did! Save your results and share them with the class. :)
    - odensc 6y ago
      Here: https://report-delta.now.sh https://report-delta.now.sh SourceHut is still the winner of most, but GitHub is a lot faster than in the report on forgeperf.org. I think the perceived speediness of GitHub for me can be mostly attributed to the fact they don't trigger a full page reload for every navigation. Whereas SourceHut is rendered completely server-side AFAIK. (I meant GitHub in my previous comment, fyi.)

I see that site is maintained by SourceHut though - are the test run from within their own DC? That could contribute to the performance score.

by odensc 6y ago

I see that site is maintained by SourceHut though - are the test run from within their own DC? That could contribute to the performance score.

battery_cowboy 6y ago

No, they do it in a fair way, I believe if you read the page it will tell you how they fairly measure performance between the forges. Edit: see "Expand for details on methodology" right at the top of the page.

odensc 6y ago
Yes, that explains their methodology but not the location of the hardware. If I go and run a Lighthouse audit on localhost vs. a server in Philadelphia there's going to be an inherent difference.
- jraph 6y ago
  I remember reading that they also ran the benchmark in Germany and got similar results when first reading about this here on hn. Anyway, it suffice to use gitlab, github, bitbucket and sourcehub for a few seconds to notice the slowness of the three first sites compared to the last one. We didn't really need the numbers to be convinced but I hope they will produce some pressure to be faster.
- battery_cowboy 6y ago
  Sorry, I seemed to remember they did something to make it fair, I don't recall the location. I use sr.ht and I've used the others and, for me, it feels like 'turbo mode' compared to them. Especially git pushing: it's faster than pushing to my dokku server that only I use!

cosmojg 6y ago

Very true. I'm in a different part of the country (I'm in Boston, they're in Philadelphia) and tried running the benchmarks myself about a week ago. Unfortunately, I didn't save the results, but if you take my word for it, I remember getting similar results with only slightly different numbers. Your best bet, of course, is to run the benchmarks yourself: https://git.sr.ht/~sircmpwn/forgeperf https://git.sr.ht/~sircmpwn/forgeperf Some other people ran the benchmarks from different places in Europe and got similar results with "nothing significantly different" from those published: https://news.ycombinator.com/item?id=22900649 https://news.ycombinator.com/item?id=22900649

odensc 6y ago
I'll try it out later today. Would be interesting to see actually because, completely anecdotally, GitLab seems faster than sr.ht in my daily usage.
- cosmojg 6y ago
  Don't make the same mistake that I did! Save your results and share them with the class. :)
  - odensc 6y ago
    Here: https://report-delta.now.sh https://report-delta.now.sh SourceHut is still the winner of most, but GitHub is a lot faster than in the report on forgeperf.org. I think the perceived speediness of GitHub for me can be mostly attributed to the fact they don't trigger a full page reload for every navigation. Whereas SourceHut is rendered completely server-side AFAIK. (I meant GitHub in my previous comment, fyi.)