5 ms·

Meanwhile, the corresponding "non-standard" desktop PC is the Framework Desktop, which with the Ryzen AI Max+ 395 can use 120GB of its 128GB RAM for the GPU: Ho

by tuukkah 7mo ago

Meanwhile, the corresponding "non-standard" desktop PC is the Framework Desktop, which with the Ryzen AI Max+ 395 can use 120GB of its 128GB RAM for the GPU: How to Run a One Trillion-Parameter LLM Locally: An AMD Ryzen™ AI Max+ Cluster Guide https://www.amd.com/en/developer/resources/technical-articles/2026/how-to-run-a-one-trillion-parameter-llm-locally-an-amd.html https://www.amd.com/en/developer/resources/technical-article...

hedgehog 7mo ago
Minisforum MS-S1 is the same chip but has a PCIe slot suitable for a network card.
- SkyMarshal 7mo ago
  Or a Beelink GTR9 Pro with same chip and memory, and two 10GbE LAN ports built in for clustering several together.
  - hedgehog 7mo ago
    The MS-S1 also has 2x 10Gb Ethernet, the value of the slot is going to a card with more bandwidth + RDMA support.
    - speed_spread 7mo ago
      You need five network cards per node to make proper hypercube. Don't settle for less!
      - LargoLasskhyfv 7mo ago
        A really good switch will do, too.
- jsheard 7mo ago
  The Framework Desktop motherboard does actually have a PCIe x4 slot, their case just doesn't expose it for whatever reason. But you can buy the board separately and put it in your own choice of Mini-ITX case which does.
  - hedgehog 7mo ago
    I saw that, it's pretty strange.
  - gpff 7mo ago
    This case is cute and well built but it does have strange quirks, see also the noisy PSU [1] [1] https://community.frame.work/t/noisy-psu-fan/74751 https://community.frame.work/t/noisy-psu-fan/74751
    - organsnyder 7mo ago
      First I've heard of this thread (I haven't spent much time on the forums for a while), but my Framework Desktop definitely has the PSU noise issue, and it doesn't seem correlated to system load. Otherwise a really solid machine.
  - AmVess 7mo ago
    That PCI slot has low power output, not suitable for what people would plug into it. Easier to cover it than run into support problems. It won't run a GPU directly. It will run an Oculink card which will allow use of an egpu.
    - jsheard 7mo ago
      I can't imagine why you'd want to buy a beefy SOC with unified memory, only to have it host a discrete GPU through it's narrow PCIe x4 interface. You'd be better off with a traditional CPU that supports a proper x16 slot.
      - coredog64 7mo ago
- tuukkah 7mo ago
  In their article, AMD chose to use the built-in 5Gbe NIC, but I read you could use the two USB4 @40Gbps ports as interconnects too (or for USB NICs).
ilovechaz 7mo ago
[flagged]
- xingped 7mo ago
  They're a small shop compared to the big laptop makers and their focus is on user-repairability. Between those two you are naturally going to have a slightly higher price point than simply buying a laptop from one of the usual companies. I wouldn't call it junk or gimmickery. It has a purpose and a niche. It might not be your niche, but it is for some people.
- davidmurdoch 7mo ago
  Why do you think that? I'm looking at getting one.
- reciprocity 7mo ago
  What are you doing here? This is both an emotional and yet unsubstantiated comment. Would you like to try again?

by tuukkah 7mo ago

hedgehog 7mo ago

Minisforum MS-S1 is the same chip but has a PCIe slot suitable for a network card.

SkyMarshal 7mo ago
Or a Beelink GTR9 Pro with same chip and memory, and two 10GbE LAN ports built in for clustering several together.
- hedgehog 7mo ago
  The MS-S1 also has 2x 10Gb Ethernet, the value of the slot is going to a card with more bandwidth + RDMA support.
  - speed_spread 7mo ago
    You need five network cards per node to make proper hypercube. Don't settle for less!
    - LargoLasskhyfv 7mo ago
      A really good switch will do, too.
jsheard 7mo ago
The Framework Desktop motherboard does actually have a PCIe x4 slot, their case just doesn't expose it for whatever reason. But you can buy the board separately and put it in your own choice of Mini-ITX case which does.
- hedgehog 7mo ago
  I saw that, it's pretty strange.
- gpff 7mo ago
  This case is cute and well built but it does have strange quirks, see also the noisy PSU [1] [1] https://community.frame.work/t/noisy-psu-fan/74751 https://community.frame.work/t/noisy-psu-fan/74751
  - organsnyder 7mo ago
    First I've heard of this thread (I haven't spent much time on the forums for a while), but my Framework Desktop definitely has the PSU noise issue, and it doesn't seem correlated to system load. Otherwise a really solid machine.
- AmVess 7mo ago
  That PCI slot has low power output, not suitable for what people would plug into it. Easier to cover it than run into support problems. It won't run a GPU directly. It will run an Oculink card which will allow use of an egpu.
  - jsheard 7mo ago
    I can't imagine why you'd want to buy a beefy SOC with unified memory, only to have it host a discrete GPU through it's narrow PCIe x4 interface. You'd be better off with a traditional CPU that supports a proper x16 slot.
    - coredog64 7mo ago
tuukkah 7mo ago
In their article, AMD chose to use the built-in 5Gbe NIC, but I read you could use the two USB4 @40Gbps ports as interconnects too (or for USB NICs).

ilovechaz 7mo ago

[flagged]

xingped 7mo ago
They're a small shop compared to the big laptop makers and their focus is on user-repairability. Between those two you are naturally going to have a slightly higher price point than simply buying a laptop from one of the usual companies. I wouldn't call it junk or gimmickery. It has a purpose and a niche. It might not be your niche, but it is for some people.
davidmurdoch 7mo ago
Why do you think that? I'm looking at getting one.
reciprocity 7mo ago
What are you doing here? This is both an emotional and yet unsubstantiated comment. Would you like to try again?