4 ms·

The M2 Ultra doesn't require doing electrical work on your house like this 8x 3090 setup did though.

by evilduck 2y ago

ein0p 2y ago
Yes, for 20x the FLOPS at about twice the price you might need to do some work.
bongodongobob 2y ago
Yeah cause it's doing like 50x less work.
NavinF 2y ago
You could power limit the 3090s to fit a standard 120V*20A = 2400W outlet if you really want to. The default power limit is 350W each so you'll only lose a little perf. Also most rooms have multiple circuits. Just connect half the GPUs to each outlet. I already do this with my desktop PC because it has 2 PSUs. Also most homes in the US have 30A*240V = 7200W dryer/stove outlets in the kitchen, laundry room, garage, etc. That's where you want to keep loud computers.
- jrflowers 2y ago
  Brb replacing my stove with a bunch of GPUs
  - lvncelot 2y ago
    Inference Oven
  - philsnow 2y ago
    Easy-bake cryptominer
  - qingcharles 2y ago
    You can cook on the GPUs from now on.
- Dylan16807 2y ago
  A standard outlet is 15A, and you're only allowed to use 80% continuously. So now you're dropping to 150W each. Using two circuits is viable.
  - NavinF 2y ago
    In the bay area every home I've lived in had 20A circuits for everything. The NEC 80% rule is only relevant in data centers where someone enforces it. The time-current curve for any 20A breaker shows that it will take infinite time to trip when you draw 20A. This is correct behavior because 12awg wire can handle 20A indefinitely
    - Dylan16807 2y ago
      Do they actually install the 20A outlets with the sideways part? I don't know if I've ever seen one in person. I guess the outlet doesn't matter a whole lot, especially if you take multiple cables to the wall. But I still don't want to be doing unenforced electrical violations.
      - NavinF 2y ago
        Some outlets have the 20A sideways part, but from a safety/code perspective that's irrelevant. Consider what happens when you plug two 10A devices into a power strip. In the US there are no true 15A rated outlets. All outlets must handle 20A because the electrical code allows any outlet to be on a 20A breaker.
        Dylan16807 2y ago
        > Consider what happens when you plug two 10A devices into a power strip. I don't know about any argument that depends on such an action being safe. There's plenty of power strips I wouldn't trust with 20 amps.
        NavinF 2y ago
        That's just how the US electrical code works. I assure you that every "15A" outlet on the wall can handle 20A. That's why products like this don't have a fuse: https://www.homedepot.com/p/Woods-2-ft-12-3-SJTW-Multi-Outlet-3-Outdoor-Extra-Heavy-Duty-Adapter-Extension-Cord-Orange-990824/301132652 https://www.homedepot.com/p/Woods-2-ft-12-3-SJTW-Multi-Outle...
santoshalper 2y ago
Sure, neither does just using ChatGPT, but we don't do things because they are easy, we do them because they are difficult.
angoragoats 2y ago
You can run 8 or even more 3090s without doing electrical work on a standard US residential power feed, you just need outlets connected to multiple circuits. This is not always convenient, which is why some may choose to do electrical work, but it’s absolutely not required.
korhojoa 2y ago
Location specific issue. Higher voltage resolves this and a regular household socket will power this just fine. Then again, if you're spending that much money to get the job done, new wiring is probably one of the cheaper parts of the build.
fallingsquirrel 2y ago
1x 3090 would be faster than the mac, cheaper than the mac, and run on a normal residential circuit. How many breakers would you need for a cluster of 20 macs running at full throttle to match the perf of OP's build?
- paulmd 2y ago
  A single 3090 won’t even fit the model. OP is talking about running a 405B model, it needs close to 200gb of memory just to open it which is why we’re talking about mac studio and it’s 192gb unified memory. This is exactly like when the AMD fanboys got a burr up their ass about the “$50k Mac Pro” with 2tb of memory… when you could the same thing with a threadripper with 256gb of memory for $5k, and it’s just as fast in Cinebench! https://old.reddit.com/r/Amd/comments/f1a0qp/15000_mac_pro_vs_5000_threadripper_sorry_apple/ https://old.reddit.com/r/Amd/comments/f1a0qp/15000_mac_pro_v... your gaming scores on your 3090 with 24gb are just as irrelevant to this 200gb workload as the threadripper is to those Mac Pro workloads lol

The M2 Ultra doesn't require doing electrical work on your house like this 8x 3090 setup did though.

ein0p 2y ago

Yes, for 20x the FLOPS at about twice the price you might need to do some work.

bongodongobob 2y ago

Yeah cause it's doing like 50x less work.

NavinF 2y ago

You could power limit the 3090s to fit a standard 120V*20A = 2400W outlet if you really want to. The default power limit is 350W each so you'll only lose a little perf. Also most rooms have multiple circuits. Just connect half the GPUs to each outlet. I already do this with my desktop PC because it has 2 PSUs. Also most homes in the US have 30A*240V = 7200W dryer/stove outlets in the kitchen, laundry room, garage, etc. That's where you want to keep loud computers.

jrflowers 2y ago
Brb replacing my stove with a bunch of GPUs
- lvncelot 2y ago
  Inference Oven
- philsnow 2y ago
  Easy-bake cryptominer
- qingcharles 2y ago
  You can cook on the GPUs from now on.
Dylan16807 2y ago
A standard outlet is 15A, and you're only allowed to use 80% continuously. So now you're dropping to 150W each. Using two circuits is viable.
- NavinF 2y ago
  In the bay area every home I've lived in had 20A circuits for everything. The NEC 80% rule is only relevant in data centers where someone enforces it. The time-current curve for any 20A breaker shows that it will take infinite time to trip when you draw 20A. This is correct behavior because 12awg wire can handle 20A indefinitely
  - Dylan16807 2y ago
    Do they actually install the 20A outlets with the sideways part? I don't know if I've ever seen one in person. I guess the outlet doesn't matter a whole lot, especially if you take multiple cables to the wall. But I still don't want to be doing unenforced electrical violations.
    - NavinF 2y ago
      Some outlets have the 20A sideways part, but from a safety/code perspective that's irrelevant. Consider what happens when you plug two 10A devices into a power strip. In the US there are no true 15A rated outlets. All outlets must handle 20A because the electrical code allows any outlet to be on a 20A breaker.
      - Dylan16807 2y ago
        > Consider what happens when you plug two 10A devices into a power strip. I don't know about any argument that depends on such an action being safe. There's plenty of power strips I wouldn't trust with 20 amps.
        NavinF 2y ago
        That's just how the US electrical code works. I assure you that every "15A" outlet on the wall can handle 20A. That's why products like this don't have a fuse: https://www.homedepot.com/p/Woods-2-ft-12-3-SJTW-Multi-Outlet-3-Outdoor-Extra-Heavy-Duty-Adapter-Extension-Cord-Orange-990824/301132652 https://www.homedepot.com/p/Woods-2-ft-12-3-SJTW-Multi-Outle...

santoshalper 2y ago

Sure, neither does just using ChatGPT, but we don't do things because they are easy, we do them because they are difficult.

angoragoats 2y ago

You can run 8 or even more 3090s without doing electrical work on a standard US residential power feed, you just need outlets connected to multiple circuits. This is not always convenient, which is why some may choose to do electrical work, but it’s absolutely not required.

korhojoa 2y ago

Location specific issue. Higher voltage resolves this and a regular household socket will power this just fine. Then again, if you're spending that much money to get the job done, new wiring is probably one of the cheaper parts of the build.

fallingsquirrel 2y ago

1x 3090 would be faster than the mac, cheaper than the mac, and run on a normal residential circuit. How many breakers would you need for a cluster of 20 macs running at full throttle to match the perf of OP's build?

paulmd 2y ago
A single 3090 won’t even fit the model. OP is talking about running a 405B model, it needs close to 200gb of memory just to open it which is why we’re talking about mac studio and it’s 192gb unified memory. This is exactly like when the AMD fanboys got a burr up their ass about the “$50k Mac Pro” with 2tb of memory… when you could the same thing with a threadripper with 256gb of memory for $5k, and it’s just as fast in Cinebench! https://old.reddit.com/r/Amd/comments/f1a0qp/15000_mac_pro_vs_5000_threadripper_sorry_apple/ https://old.reddit.com/r/Amd/comments/f1a0qp/15000_mac_pro_v... your gaming scores on your 3090 with 24gb are just as irrelevant to this 200gb workload as the threadripper is to those Mac Pro workloads lol