4 ms·

How about ARM? Included in the report?

matdehaast 4y ago
Last I checked cockroach don’t support ARM binaries. Probably means they thought not worth the effort to do the analysis on those instances as it doesn’t help for their offering
- Thaxll 4y ago
  It does supports ARM. It's a Go project so it should except if they do exotic things.
  - _joel 4y ago
    Explained why they don't produce official, supported builds. https://github.com/cockroachdb/cockroach/issues/62903#issuecomment-864922029 https://github.com/cockroachdb/cockroach/issues/62903#issuec...
    - estambar 4y ago
      We're planning on having official ARM binaries in the fall, so I expect ARM benchmarks will return in next year's report
      - _joel 4y ago
        Awesome, can't wait to test :)
  - colinmhayes 4y ago
    I work on a similar product to cockroach. We inject assembly into our code, wouldn't be surprised if they do too.
guepe 4y ago
There is very little offering and honestly afaik they are not competing on performance except niche applications. It's not that easy to displace x86...
- colinmhayes 4y ago
  As far as I know most AWS services can be run on graviton instances.
- StillBored 4y ago
  I'm not sure that is accurate for Gravaton3, which appears to be besting intel/amd in a number of cases. So, it doesn't appear there is a clear leader between the amd, intel and gravaton instances. Meaning everyone should be benchmarking their application and picking one. https://www.phoronix.com/scan.php?page=article&item=graviton3-amd-intel&num=1 https://www.phoronix.com/scan.php?page=article&item=graviton... Amazon here seems to be leading the Arm technology pack, as they are using a newer generation of CPU, while arm instances on other providers tend to be providing gravaton2 (Neoverse-N1) based instances. I would imagine that gradually changing in the near future as those vendors also upgrade.
- canucklady 4y ago
  Graviton3 on AWS is better for most applications on a cost/performance basis, and in some cases also on straight latency. Honeycomb has some great blogs about it: https://www.honeycomb.io/blog/present-future-arm-aws-graviton-honeycomb/ https://www.honeycomb.io/blog/present-future-arm-aws-gravito...
  - guepe 4y ago
    I stand corrected ! Note that is on cost/performance, not raw performance yet. Impressive.
    - coder543 4y ago
      And on raw performance: https://www.phoronix.com/scan.php?page=article&item=graviton3-amd-intel&num=9 https://www.phoronix.com/scan.php?page=article&item=graviton... (direct link to the geometric mean performance of the whole test suite) ARM isn't the optimal solution for every application at this time, but anyone who isn't seriously considering it probably needs to update their information.
asdajksah2123 4y ago
lbhdc 4y ago
From the pdf of the report >We chose not to test ARM instance types this year as CockroachDB still does not provide official binaries for that processor platform. Official support for ARM binaries is slated for our Fall release (22.2), so we expect to return to testing this processor platform next year.

Last I checked cockroach don’t support ARM binaries. Probably means they thought not worth the effort to do the analysis on those instances as it doesn’t help for their offering

Thaxll 4y ago
It does supports ARM. It's a Go project so it should except if they do exotic things.
- _joel 4y ago
  Explained why they don't produce official, supported builds. https://github.com/cockroachdb/cockroach/issues/62903#issuecomment-864922029 https://github.com/cockroachdb/cockroach/issues/62903#issuec...
  - estambar 4y ago
    We're planning on having official ARM binaries in the fall, so I expect ARM benchmarks will return in next year's report
    - _joel 4y ago
      Awesome, can't wait to test :)
- colinmhayes 4y ago
  I work on a similar product to cockroach. We inject assembly into our code, wouldn't be surprised if they do too.

guepe 4y ago

There is very little offering and honestly afaik they are not competing on performance except niche applications. It's not that easy to displace x86...

colinmhayes 4y ago
As far as I know most AWS services can be run on graviton instances.
StillBored 4y ago
I'm not sure that is accurate for Gravaton3, which appears to be besting intel/amd in a number of cases. So, it doesn't appear there is a clear leader between the amd, intel and gravaton instances. Meaning everyone should be benchmarking their application and picking one. https://www.phoronix.com/scan.php?page=article&item=graviton3-amd-intel&num=1 https://www.phoronix.com/scan.php?page=article&item=graviton... Amazon here seems to be leading the Arm technology pack, as they are using a newer generation of CPU, while arm instances on other providers tend to be providing gravaton2 (Neoverse-N1) based instances. I would imagine that gradually changing in the near future as those vendors also upgrade.
canucklady 4y ago
Graviton3 on AWS is better for most applications on a cost/performance basis, and in some cases also on straight latency. Honeycomb has some great blogs about it: https://www.honeycomb.io/blog/present-future-arm-aws-graviton-honeycomb/ https://www.honeycomb.io/blog/present-future-arm-aws-gravito...
- guepe 4y ago
  I stand corrected ! Note that is on cost/performance, not raw performance yet. Impressive.
  - coder543 4y ago
    And on raw performance: https://www.phoronix.com/scan.php?page=article&item=graviton3-amd-intel&num=9 https://www.phoronix.com/scan.php?page=article&item=graviton... (direct link to the geometric mean performance of the whole test suite) ARM isn't the optimal solution for every application at this time, but anyone who isn't seriously considering it probably needs to update their information.

asdajksah2123 4y ago

lbhdc 4y ago

From the pdf of the report >We chose not to test ARM instance types this year as CockroachDB still does not provide official binaries for that processor platform. Official support for ARM binaries is slated for our Fall release (22.2), so we expect to return to testing this processor platform next year.