4 ms·
Wait, a $7000 computer doesn’t come with a discrete GPU?
by seanmcdirmid 3y ago
Wait, a $7000 computer doesn’t come with a discrete GPU?
- StewardMcOy 3y agoIt's not just that it doesn't come with a discrete GPU. Apple Silicon doesn't support discrete GPUs to begin with. As far as I understand it—and this is just from watching Apple's presentations on the architecture—the lack of a discrete GPU is a big part of how the Apple Silicon machines achieve good performance per watt. Instead of having discrete RAM or a discrete GPU with its own VRAM, all of the RAM is accessible to the CPU and and the GPU in a unified memory architecture. On the M2 Ultra, this allows for 800 GB/s of memory bandwidth, and also eliminates a lot of the need to copy data from RAM to VRAM, as both the GPU and the CPU can access the same memory. In return, this allows the GPU to match the performance of discrete GPUs that have a lot more cores. Of course, the big downside is that you can't expand the RAM or install a beefier GPU. It's all baked in to the logic board.
- wtallis 3y ago> and also eliminates a lot of the need to copy data from RAM to VRAM, as both the GPU and the CPU can access the same memory. In return, this allows the GPU to match the performance of discrete GPUs that have a lot more cores. Plenty of PC hardware reviewers have done sensitivity analysis experiments to see how discrete GPU performance is affected by running with a slower or narrower PCIe link. The consensus is usually that GPUs connected by PCIe have more than sufficient bandwidth, and cutting it in half only affects gaming framerates by a few percent. Tighter coupling between CPU and GPU can plausibly have a bigger impact for some GPU compute workloads, but for traditional 3D graphics it doesn't help performance much.
- Retric 3y agoYou can generally ignore FPS numbers as irrelevant outside of extremes, what people notice is stutter and that’s where PCIe link bandwidth matters.
- wtallis 3y agoI think it's more accurate to say that PCIe link bandwidth matters when your VRAM capacity starts to become insufficient, a problem that Apple sidesteps. The key advantage of Apple's unified memory strategy isn't fast communication between CPU and GPU, but in granting the GPU access to a high-capacity memory pool (with some side benefits of giving the CPU access to GPU-like memory bandwidth).
- dtx1 3y agoMeasured as one percent lows and again, most GPUs under most Conditions simply don't saturate PCIe enough for that to make a difference. Der8auer and GamersNexus on youtube have plenty of examples.
- Retric 3y ago1% lows in a given benchmark isn’t really measuring stutter in practice, what you want is percentage of frames that don’t finish in time. If once a minute you miss 4 frames in a row that’s noticeable even if everything else is rock solid. The thing is people adjust their resolution/settings to reach acceptable FPS, thus it’s fairly GPU independent. What matters is rendering volatility as assets are loaded etc.
- sudosysgen 3y agoThat metric is irrelevant now that we have adaptive refresh rates. You don't really "miss" a frame anymore. 1% low is now the correct metric.
- Retric 3y agoIf the pipeline stalls for 70ms it’s a problem even if in theory you don’t “miss” a frame you still aren’t getting new frames until rendering finishes. All adaptive refresh rates do is avoiding unwanted delays after the frame finishes.
- 3y ago
- astrange 3y agoThe only reason it wouldn't matter is that software is designed for it to not matter. It enables software to be designed differently ie by not having to ever copy things to VRAM.
- wtallis 3y agoThat's true to an extent, but when discussing the current performance of GPU hardware the context is necessarily software that actually exists rather than hypothetical software that could exist in the future. The high CPU-to-GPU bandwidth is not currently enabling Apple's GPUs to punch above their weight class (GFLOPS or whatever) except in scenarios where competing GPUs simply don't have enough VRAM. In a future where applications are written with Apple's architecture in mind, any advantage this provides would pretty much boil down to using more VRAM because VRAM capacity isn't as limited anymore.
- deleted 3y ago[deleted]
- numpad0 3y agoOr memory slots, or dual/quad socket capability, or compatibility with the GPU card for previous gen Mac Pro. You get one multicore ARM SoC with 192GB of on-package L4 cache and integrated graphics, and that’s it. While 192GB of RAM is more than I would need, for people looking to use 1.5TB of RAM and a pair of NVIDIA GPU they had from previous model, they’d have to go elsewhere. Which leaves me wondering; how much engineering at Apple are happening on Mac?
- cozzyd 3y agoNot much engineering software runs on MacOS.