7 ms·

Impressive although reading that they used 448 cores on super-expensive Intel lab machines takes the edge off a little

by nmstoker 9y ago

AmVess 9y ago
1,280,625,752,550 rows per second is pretty impressive even if it was done on a million dollar's worth of CPU.
- StreamBright 9y ago
  And do you have a business use case that requires that?
  - rplnt 9y ago
    Analytics, BI, ... More about rows/second it's about lowering minutes/operation.
  - manigandham 9y ago
    Some people do... but this is about showing the potential.
  - AndyNemmity 9y ago
    I've worked on a ton of businesses cases that require it. This is what I worked on for years. It's generally a large company, large issue sort of problem. You can throw millions in hardware/software into a problem that saves you 100's of millions.
    - nikita 9y ago
      We can solve it quite efficiently. You can define an index on a columnstore table and we will maintain order on a per node basis
- mnw21cam 9y ago
  So, for anyone who thought the headline was a little bit excessive, it looks like this article is using short-scale trillion and billion.
  - nayuki 9y ago
    Who uses the long scale in English?
    - mnw21cam 9y ago
      Um. England? (Except the BBC and parliament, and I have no idea why.)
tgtweak 9y ago
We use it on inexpensive second hand R810s with 256G of ram and 4x 10-core xeons of yesteryear. These can be found reasonably cheap: https://m.ebay.ca/itm/Dell-Poweredge-R810-II-4x-Ten-Core-Xeon-E7-4870-2-4GHz-256GB-H700-4x-480GB-SSD-/392000130416?nav=SEARCH https://m.ebay.ca/itm/Dell-Poweredge-R810-II-4x-Ten-Core-Xeo... Edit: while these cpus don't have avx/avx2, they still give good results and don't cost $40,000 per server. The best value system with avx2 would be a dual e5-2650v3 such as this one: https://m.ebay.ca/itm/DELL-POWEREDGE-R430-SERVER-2-X-E5-2650V3-2-3GHZ-256GB-NO-HDD-S130-/312084239575?nav=SEARCH https://m.ebay.ca/itm/DELL-POWEREDGE-R430-SERVER-2-X-E5-2650...
- lazyjones 9y ago
  What's the licensing cost for MemSQL per server for this?
  - tgtweak 9y ago
    If you go with Enterprise edition (we use community) it used to be in the 4-digits for a support contract and some operational niceties (streaming native backup and restore).
    - cbg0 9y ago
      They no longer seem to have a community offering, only paid. Also, having asked at one point, they say their pricing starts at $25K/year.
      - qeternity 9y ago
        They renamed the CE to "Dev Edition" and I think now commercial use is prohibited.
        AndyNemmity 9y ago
        They used to try and confuse the issue to make it seem like they were open source, now they don't even have a free to use option? "Start Using MemSQL Community Edition Now Unlimited scale and capacity. Free forever.".... Free forever right? Now it doesn't exist.

Impressive although reading that they used 448 cores on super-expensive Intel lab machines takes the edge off a little

AmVess 9y ago

1,280,625,752,550 rows per second is pretty impressive even if it was done on a million dollar's worth of CPU.

StreamBright 9y ago
And do you have a business use case that requires that?
- rplnt 9y ago
  Analytics, BI, ... More about rows/second it's about lowering minutes/operation.
- manigandham 9y ago
  Some people do... but this is about showing the potential.
- AndyNemmity 9y ago
  I've worked on a ton of businesses cases that require it. This is what I worked on for years. It's generally a large company, large issue sort of problem. You can throw millions in hardware/software into a problem that saves you 100's of millions.
  - nikita 9y ago
    We can solve it quite efficiently. You can define an index on a columnstore table and we will maintain order on a per node basis
mnw21cam 9y ago
So, for anyone who thought the headline was a little bit excessive, it looks like this article is using short-scale trillion and billion.
- nayuki 9y ago
  Who uses the long scale in English?
  - mnw21cam 9y ago
    Um. England? (Except the BBC and parliament, and I have no idea why.)

tgtweak 9y ago

We use it on inexpensive second hand R810s with 256G of ram and 4x 10-core xeons of yesteryear. These can be found reasonably cheap: https://m.ebay.ca/itm/Dell-Poweredge-R810-II-4x-Ten-Core-Xeon-E7-4870-2-4GHz-256GB-H700-4x-480GB-SSD-/392000130416?nav=SEARCH https://m.ebay.ca/itm/Dell-Poweredge-R810-II-4x-Ten-Core-Xeo... Edit: while these cpus don't have avx/avx2, they still give good results and don't cost $40,000 per server. The best value system with avx2 would be a dual e5-2650v3 such as this one: https://m.ebay.ca/itm/DELL-POWEREDGE-R430-SERVER-2-X-E5-2650V3-2-3GHZ-256GB-NO-HDD-S130-/312084239575?nav=SEARCH https://m.ebay.ca/itm/DELL-POWEREDGE-R430-SERVER-2-X-E5-2650...

lazyjones 9y ago
What's the licensing cost for MemSQL per server for this?
- tgtweak 9y ago
  If you go with Enterprise edition (we use community) it used to be in the 4-digits for a support contract and some operational niceties (streaming native backup and restore).
  - cbg0 9y ago
    They no longer seem to have a community offering, only paid. Also, having asked at one point, they say their pricing starts at $25K/year.
    - qeternity 9y ago
      They renamed the CE to "Dev Edition" and I think now commercial use is prohibited.
      - AndyNemmity 9y ago
        They used to try and confuse the issue to make it seem like they were open source, now they don't even have a free to use option? "Start Using MemSQL Community Edition Now Unlimited scale and capacity. Free forever.".... Free forever right? Now it doesn't exist.