3 ms·

With the power being 70W from the connector only, how feasible is it to have 3 per server and have effectively 48GB VRAM for tasks?

addisonj 1y ago
I think the answer to that right now is highly workload dependent. From what I have seen, it is improving rapidly, but still very early days for the software stack compared to Nvidia
adgjlsfhk1 1y ago
You're probably better off with the incoming B60 which has 24GB vram.
- syntaxing 1y ago
  There’s a 48GB B60 already [1] but it’s definitely a significant amount more than 3X B50 pro (you obviously get way better performance). [1] https://www.maxsun.com/products/intel-arc-pro-b60-dual-48g-turbo https://www.maxsun.com/products/intel-arc-pro-b60-dual-48g-t...
  - kadoban 1y ago
    > There’s a 48GB B60 already Kind of. It's more two 24gb b60s in a trenchcoat. It connects to one slot but it's two completely separate gpus and requires the board to support pcie bifurcation.
    - magicalhippo 1y ago
      > and requires the board to support pcie bifurcation And lanes. My board has two PCIe x16 slots fed by the CPU, but if I use both they'll only get x8 lanes each. Thus if I plugged two of these in there, I'd still only have two working GPUs, not four.
  - cmxch 1y ago
    No good if the cost is identical to a 5090.
    - adgjlsfhk1 1y ago
      good news! it's $1200, so roughly half price of a 5090
      - cmxch 1y ago
        I’d like to know where, since Maxsun has pointed to a US distributor that had a $2999 order price for the B60 dual.
  - blagie 1y ago
    Four of these together should, in the abstract, let you run 200GB models, which is where things get very, very interesting. The biggest Deepseek V2 models would just fit, as would some of the giant Meta open source models. Those have rather pleasant performance. In theory, how feasible is that? I feel like the software stack might be like a Jenga tower. And PCIe limitations might hit pretty hard.
  - swores 1y ago
    I'm confused by this line on that page, can anyone explain what they mean? > "Because 48GB is for spreadsheets, feed your rendering beast with a buffet of VRAM." Edit: I guess must just be a bad translation or sloppy copywriting, and they mean it's not for just spreadsheets rather than it is...

addisonj 1y ago

I think the answer to that right now is highly workload dependent. From what I have seen, it is improving rapidly, but still very early days for the software stack compared to Nvidia

adgjlsfhk1 1y ago

You're probably better off with the incoming B60 which has 24GB vram.

syntaxing 1y ago
There’s a 48GB B60 already [1] but it’s definitely a significant amount more than 3X B50 pro (you obviously get way better performance). [1] https://www.maxsun.com/products/intel-arc-pro-b60-dual-48g-turbo https://www.maxsun.com/products/intel-arc-pro-b60-dual-48g-t...
- kadoban 1y ago
  > There’s a 48GB B60 already Kind of. It's more two 24gb b60s in a trenchcoat. It connects to one slot but it's two completely separate gpus and requires the board to support pcie bifurcation.
  - magicalhippo 1y ago
    > and requires the board to support pcie bifurcation And lanes. My board has two PCIe x16 slots fed by the CPU, but if I use both they'll only get x8 lanes each. Thus if I plugged two of these in there, I'd still only have two working GPUs, not four.
- cmxch 1y ago
  No good if the cost is identical to a 5090.
  - adgjlsfhk1 1y ago
    good news! it's $1200, so roughly half price of a 5090
    - cmxch 1y ago
      I’d like to know where, since Maxsun has pointed to a US distributor that had a $2999 order price for the B60 dual.
- blagie 1y ago
  Four of these together should, in the abstract, let you run 200GB models, which is where things get very, very interesting. The biggest Deepseek V2 models would just fit, as would some of the giant Meta open source models. Those have rather pleasant performance. In theory, how feasible is that? I feel like the software stack might be like a Jenga tower. And PCIe limitations might hit pretty hard.
- swores 1y ago
  I'm confused by this line on that page, can anyone explain what they mean? > "Because 48GB is for spreadsheets, feed your rendering beast with a buffet of VRAM." Edit: I guess must just be a bad translation or sloppy copywriting, and they mean it's not for just spreadsheets rather than it is...