3 ms·

I think these are totally different spaces. Th OP is for an AI dev machine. Framework Desktop is general purpose.

rbanffy 2y ago
Any computer is general purpose if you want it hard enough. I hope this being more accessible than other Nvidia gear allows it to develop a healthy software ecosystem that doesn't depend so much on Nvidia.
- eckelhesten 2y ago
  >Any computer is general purpose if you want it hard enough. True, but not any general purpose computer comes with 1000TOPS of computational power.
- sliken 2y ago
  1000 TOPS sounds good, until you notice the 273GB/sec. This will allow larger models than consumer GPUs, but be rather slow running them.
jauntywundrkind 2y ago
They both have ~0.25TBps memory bandwidth & huge GPUs. They very much are in the same space. I'm very Team Red (AMD) but I dig & respect the 4x 40Gbps USB ports here. Its not popular but it is a good way to attach pretty fast storage. Also the 200Gbps connect-x7 is just awesome. Users can add what they will to Strix Halo, but it's neat seeing good connectivity on chip. I hope AMD can get better about USB4 & Thunderbolt 4. It really feels like it should be part of their APUs. Apple shipping 6x TB5 ports on the new M3 Ultra is a beautiful example of what life should be like.
- rbanffy 2y ago
  > They very much are in the same space. I would place the Asus a peg above the Framework in both CPU and GPU. It also has a bit higher memory bandwidth. All in all, it's pretty close, but what really sets it apart from anything else that size is the network connectivity: one 10Gbe port and a pair of X7 connectors intended for clustering. > Apple shipping 6x TB5 ports on the new M3 Ultra is a beautiful example of what life should be like. AMD is well positioned to build specialized products if this niche proves profitable. I can easily imagine them making cut down versions of their MI300A with varying numbers of CPU and GPU tiles. What I dislike about this is the size. They could make it a bit larger, which would, unavoidably, make it quieter as well.
sliken 2y ago
Sort of. Sure you can game on the framework desktop, but I'd expect them to do similar on inference workloads and come with the same max ram and bandwidth.

Any computer is general purpose if you want it hard enough. I hope this being more accessible than other Nvidia gear allows it to develop a healthy software ecosystem that doesn't depend so much on Nvidia.

eckelhesten 2y ago
>Any computer is general purpose if you want it hard enough. True, but not any general purpose computer comes with 1000TOPS of computational power.
sliken 2y ago
1000 TOPS sounds good, until you notice the 273GB/sec. This will allow larger models than consumer GPUs, but be rather slow running them.

jauntywundrkind 2y ago

They both have ~0.25TBps memory bandwidth & huge GPUs. They very much are in the same space. I'm very Team Red (AMD) but I dig & respect the 4x 40Gbps USB ports here. Its not popular but it is a good way to attach pretty fast storage. Also the 200Gbps connect-x7 is just awesome. Users can add what they will to Strix Halo, but it's neat seeing good connectivity on chip. I hope AMD can get better about USB4 & Thunderbolt 4. It really feels like it should be part of their APUs. Apple shipping 6x TB5 ports on the new M3 Ultra is a beautiful example of what life should be like.

rbanffy 2y ago
> They very much are in the same space. I would place the Asus a peg above the Framework in both CPU and GPU. It also has a bit higher memory bandwidth. All in all, it's pretty close, but what really sets it apart from anything else that size is the network connectivity: one 10Gbe port and a pair of X7 connectors intended for clustering. > Apple shipping 6x TB5 ports on the new M3 Ultra is a beautiful example of what life should be like. AMD is well positioned to build specialized products if this niche proves profitable. I can easily imagine them making cut down versions of their MI300A with varying numbers of CPU and GPU tiles. What I dislike about this is the size. They could make it a bit larger, which would, unavoidably, make it quieter as well.

sliken 2y ago

Sort of. Sure you can game on the framework desktop, but I'd expect them to do similar on inference workloads and come with the same max ram and bandwidth.