7 ms·
50% slower than the absolute best of class NVIDIA discrete GPU offering that consumes massively more wattage is hardly a damning statement.
by adastra22 3y ago
50% slower than the absolute best of class NVIDIA discrete GPU offering that consumes massively more wattage is hardly a damning statement.
- MBCook 3y agoThe complete lack of any power numbers is extremely telling.
- jacooper 3y agoAs if that matters on a desktop?
- mort96 3y agoIt matters when comparing performance numbers in general?
- jacooper 3y agoDepending on the usage, it why AMDs efficiency is impressive on laptops, but not so important on the desktop.
- ianai 3y agoPerformance per TDP is always relevant. Sure individuals may choose they just want whatever to maximize a metric, but that’s a different decision entirely. Like comparing a motorcycle and a truck without mentioning all the things different between the two.
- sokoloff 3y agoTDP is the wrong measure here. i9-13900K and i7-13700K both have 125W TDP with 253W PL2 specs. By that calculation, the 13900K is more performant per TDP, so is "better" for efficiency. Computation per kWh (or rate of computation per kW) is the right efficiency metric, not TDP (thermal design power).
- wtallis 3y agoIf you have a workload that pushes the 13700K and 13900K to their turbo limits (and have ensured that those limits are actually configured to be the same), then you really will find the 13900K getting more work done for the same power and energy. That's how the extra cores help in power-limited scenarios.
- throwaway5959 3y agoIt does when you multiply it across millions of CPUs. Saving 100 watts across 3 million CPUs (300 megawatts) is enough to shut down the equivalent of power plants.
- nightski 3y agoI'm all for efficiency but if we are to progress as a civilization we need to find a way to not have power hold us back. We can get to a point where we have nearly unlimited power with minimal impact on the environment around us. That needs to happen as soon as possible.
- chongli 3y agoThere are an estimated 3 billion people in the world who still rely on solid fuel (wood, coal, peat moss) to cook food and generate heat [1]. We are extremely far away from being able to use 100% electricity to meet two basic needs for the whole population. From that perspective power-plant-scale computing is an incredible luxury. [1] https://www.jstor.org/stable/pdf/resrep27829.23.pdf https://www.jstor.org/stable/pdf/resrep27829.23.pdf
- nightski 3y agoThat demand will only increase, which further emphasizes my point. It can't be a luxury.
- alpaca128 3y ago> That needs to happen as soon as possible. But it won't happen before all M2/3 Macs will be obsolete. Having goals like that is great but until we reach that point efficiency is still important.
- st3fan 3y agoI don't like to listen to the sound of fans constantly running ...
- deleted 3y ago[deleted]
- smoldesu 3y agoThe absolute "best of class" Nvidia card is currently the 4090, which can be up to 30% faster than the 4080 in scaling workloads. What would be more interesting is to see how Nvidia's laptop cards fare here though - they're constrained to much lower wattage (80-120w) and would make for a much fairer fight against the ~200w M2 Ultra.
- nordsieck 3y ago> What would be more interesting is to see how Nvidia's laptop cards fare here though - they're constrained to much lower wattage (80-120w) and would make for a much fairer fight against the ~200w M2 Ultra. Doesn't look like Apple offers Ultra in a laptop - just the Basic, Pro, and Max.
- arpanetus 3y agoIt's interesting. I assumed at least their power consumption should have been much better/lower than an avg orthodox desktop setup of current days.
- smoldesu 3y agoIt's not unreasonably high for a TDP, and the idle consumption of ARM is de-facto lower than power an x86 package. That being said, it's pretty obvious that Apple's mobile-style solution isn't really working out on the desktop side of things. The new iMac feels starkly pedestrian compared to the old ones, and the Mac Mini/Studio are both neat but not unprecedented. The M2 Ultra represents a lot of engineering effort going into flipping that status quo, but its still slipping behind by a considerable margin. Don't forget that a second "Ultra" style SOC with 4x M1 Maxes was supposedly cancelled for drawing too much power and being too hot. It's just not effective or efficient to force that much silicon that close together.
- smcleod 3y agoA decent 4090 GPU alone is over $3000 in Australia - that’s half the price of a Mac Studio with Ultra - just for the GPU. Then you’d be looking for a 24 core CPU, 64GB RAM, 1TB PCIe 5 SSD, mainboard with 6x thunderbolt ports, a silent cooling setup, high quality case that is both small and all the gear while running cool. and if you’re stuck with MS Windows - an Operating System.
- caycep 3y agogranted, wccftech is a grain of salt kind of site. To wit, here's another article....from the same site! https://wccftech.com/m2-ultra-only-10-percent-slower-than-rtx-4080-in-metal/ https://wccftech.com/m2-ultra-only-10-percent-slower-than-rt...
- deleted 3y ago[deleted]
- olyjohn 3y ago[flagged]
- weego 3y agoMy audi S5 is slower than a GT3 Touring car. It's just excuses.
- peoplefromibiza 3y ago> that consumes massively more wattage power consumption doesn't scale linearly with performances the absolute best of class NVIDIA discrete GPU offering could possibly outperform the Apple GPU at the same power level Or, to put it in another way, to recover that remaining 50% of performances (2x) the increase in power consumption would be exponential (a lot more than 2x, like 10x)
- BoorishBears 3y agoThey said it's not faster than the desktop parts, which is almost a false statement since it actually is faster at multithreaded than both base desktop SKUs. And then they switch to providing a specific percentage when comparing the the 4080 (also based on an deceptively narrow comparison, one their other articles counter) for dramatic effect. I don't think it was ever meant to be the most informative article: it seems written to serve the contrarians because that's profitable from a readership perspective for a publication like this.
- jacooper 3y agoAbsolute best of class? What? A 4080 is best of class? And second of all, for the price it should be compared to the 4090, which absolutely demolishes it.
- garbagecoder 3y agoMy M1 Pro is about 33% as fast as a box with a 3060 in it on PyTorch and obviously it is way more efficient and doesn't require a special power supply, which is just taken for granted as something you have to do with a PC. The best case this article can make is that if you need to play the latest game or do intense ML stuff you probably want NVIDIA, but that's the same as it ever was.
- incrudible 3y agoIt also costs a lot more. For the money you can get a laptop with a 4080m and reduce its power limit and probably get the same or better efficiency, but with room to the top if you need it.
- garbagecoder 3y agoAnd I like it more, so I am willing to pay more. The implicit notion that I’m getting the same thing for less just isn’t true.
- incrudible 3y agoYou are getting better performance potential and equal or better efficiency at comparable wattage, for a better price. Of course you will not get it the shape of an Apple laptop. We were talking about how Apple chips supposedly have superior efficiency, but at least in terms of GPU that is not true at all.
- partiallypro 3y agoMost consumers don't care about wattage on a desktop, and when you compare the prices they are similar and it loses.
- readthenotes1 3y agoI wonder how long you have to run the Apple chip to save enough on electricity to make the price difference worthwhile? Does it only drop to one human lifetime in places where energy cost is insanely high?
- acdha 3y agoMany people do care - many Americans have subsidized low power but that’s not globally true and even if your power is free a hot CPU means you’re listening to fan noise and heating up the room. In a cold winter that’s not bad but I knew people who had to do things like leave their office doors open for cooling.
- 0zemp3c 3y agothe people you describe aren't buying $7k desktops
- acdha 3y agoThey certainly are. Being able to pay for the extra power doesn’t mean you like fan noise, not to mention the people who are doing things like video production in a trailer where overheating is a concern. I used to support scientists who didn’t appreciate the heat 4 workstations made in their shared offices, either.
- incrudible 3y agoA dedicated GPU with more die area and its own large fan will run both cooler and quieter when its power limit is reduced to match the performance of the Apple chip.
- captainbland 3y agoI think a useful way of thinking about this is it has something like $300-400 worth of discrete GPU equivalent performance assuming that the article's claims are correct (not exactly a given...) as it will get you something similar to a 3060 ti or 4060 ti.
- seanmcdirmid 3y agoWait, a $7000 computer doesn’t come with a discrete GPU?
- StewardMcOy 3y agoIt's not just that it doesn't come with a discrete GPU. Apple Silicon doesn't support discrete GPUs to begin with. As far as I understand it—and this is just from watching Apple's presentations on the architecture—the lack of a discrete GPU is a big part of how the Apple Silicon machines achieve good performance per watt. Instead of having discrete RAM or a discrete GPU with its own VRAM, all of the RAM is accessible to the CPU and and the GPU in a unified memory architecture. On the M2 Ultra, this allows for 800 GB/s of memory bandwidth, and also eliminates a lot of the need to copy data from RAM to VRAM, as both the GPU and the CPU can access the same memory. In return, this allows the GPU to match the performance of discrete GPUs that have a lot more cores. Of course, the big downside is that you can't expand the RAM or install a beefier GPU. It's all baked in to the logic board.
- wtallis 3y ago> and also eliminates a lot of the need to copy data from RAM to VRAM, as both the GPU and the CPU can access the same memory. In return, this allows the GPU to match the performance of discrete GPUs that have a lot more cores. Plenty of PC hardware reviewers have done sensitivity analysis experiments to see how discrete GPU performance is affected by running with a slower or narrower PCIe link. The consensus is usually that GPUs connected by PCIe have more than sufficient bandwidth, and cutting it in half only affects gaming framerates by a few percent. Tighter coupling between CPU and GPU can plausibly have a bigger impact for some GPU compute workloads, but for traditional 3D graphics it doesn't help performance much.
- Retric 3y agoYou can generally ignore FPS numbers as irrelevant outside of extremes, what people notice is stutter and that’s where PCIe link bandwidth matters.
- TradingPlaces 3y agoThe article does not say if it’s a Mac Studio or Mac Pro. I think that matters. My understanding is that there is no TDP on Apple Silicon, and that it has a lot of runway in a less constrained thermal environment like the new Mac Pro vs Mac Studio. While I’m still surprised they didn’t put a second Ultra in the Mac Pro, I’m betting there’s a wider delta than people imagine between the two form factors.
- wmf 3y agoThe Mac Studio doesn't throttle so there is no extra headroom for the Mac Pro.
- TradingPlaces 3y agoWe’ll find out next week
- brucethemoose2 3y agoTake anything from wccf with a grain of salt. And yeah, as others point out, this is Apples to oranges. x86 desktops are great at some things, M2 Ultras are great at others, and the overlap that really matters is pretty small... Like, you have to be crazy to buy an M SoC for gaming, or buy a Nvidia GPU for workloads that won't fit in VRAM.
- perrohunter 3y agoI tested the new game porting kit on a Mac mini M2 and was surprised I was able to run Cyberpunk 2077 and it was running really well, I can imagine that more powerful M processors will be awesome, so the argument of games might go away soon
- katbyte 3y agoHow does it work? You install a windows game via steam and then tell it to port?
- stouset 3y agoIt’s basically Wine with a custom D12 translation to Metal calls. Right now it’s not really intended for end-users so the experience involves a lot of steps that aren’t consumer-friendly, but some folks are publishing wrappers that simplify the process. I imagine that in the future, something like Steam will wrap this functionality to provide the ability to run the whole library under the toolkit. And individually-published games will do the same so they install and run with a more consumer-friendly experience.
- imbnwa 3y agoCurious about settings for an idea of the ceiling, that game is insanely unoptimized
- Grazester 3y agoWhat is really well? Can me have a metric? What resolution and what frame rate?
- 2OEH8eoCRo0 3y agoFor $7,000 there should be no caveats, it should be beating every measurable metric outright.
- liuliu 3y agoI don't know. Nowadays a top-of-the-spec Linux workstation without any cost on top (i.e. bare-components) is around ~10k. 5995WX in the graph wccf provided alone costs ~5k.
- microtonal 3y agoFirst, a Mac Studio with M1 Ultra is $3999. Second, people don't buy Macs only for performance. They also buy Macs for macOS, for integration between devices, for a system that is cool and quiet, for hardware acceleration of ProRes, for on-device privacy-preserving machine learning. Being a bit slower than competing AMD and Intel systems is acceptable, because you get so many other desirable properties in return. I'd definitely consider a Mac Studio with an M2 Max or M2 Ultra, if I didn't want something portable. I would never buy a machine with a competing machine with an Intel or AMD machine, because I don't want to deal with Windows or desktop Linux. Other people have another set of priorities and that is fine.
- microtonal 3y agoMaybe, but most of these comparisons are based on GPU performance (ie. games). For other workloads like machine learning, Tensor cores on NVIDIA GPUs will blow Apple Silicon GPUs out of the water. The M2 Ultra is 27 TFLOPS. The 4080't Tensor Cores are 48.7 TFLOPS in FP32, 194.9 TFLOPS in FP16, 389.9 TFLOPS in FP8 with FP16 accumulate. (IIRC on Apple Silicon GPUs FP16 performance is roughly the same as FP32.) (There is the Neural Engine which supports lower precision, but it limited in various ways.) Regardless, the strides that Apple has been making are impressive.
- sunflowerfly 3y agoOne differentiator is the amount of memory available. Apple's shared pool of memory means the GPU has potentially up to 96gb of ram at its disposal, where discrete GPU's are often limited to 8, 12, 16, etc. They mentioned in the keynote that the M2 can handle many tasks discrete GPUs cannot simply because they run out of ram.
- incrudible 3y ago$15,000 will buy you an A100 with 80GB of RAM at 2TB/s that will annihilate the biggest Apple chip.
- ElFitz 3y agoSure, but then that’s the price of multiple entire laptops. Or 2 Mac Pros. Not sure what point you’re trying to make here.
- incrudible 3y agoIt is also the performance of 4 Mac Pros. GP was talking about tasks that dedicated GPUs supposedly could not handle. Who is is running models needing 60+ GB of VRAM on their laptops?
- ElFitz 3y ago
- MegaDeKay 3y agoThe article reports that the M2 Ultra is basically even with a 4060 Ti in OpenCL compute which they refer to as a mainstream card. It is more a notch above entry level. The "best of class" 4090 is actually 2.5x faster. But again, this is OpenCL so who knows how the two compare in a more relevant benchmark. Regardless, wccftech is far from reliable. IIRC, /r/amd blocks links to the site.
- incrudible 3y agoNVIDIA still beats Apple even in efficiency, or so I have read. If you care about wattage that much, you can just underclock and undervolt your GPU. It is free and the police can not stop you.
- the8472 3y ago> best of class NVIDIA discrete GPU offering Those are nvidia's best consumer GPUs. I think the cheese grater falls into the pro segment. In that segment nvidia has the A6000s with 48GB VRAM and 91 SP TFlops compared to the 4090's 24GB and 73 SP TFlops. But that costs as much as the Mac Pro alone. And even bigger options (segmented for server/datacenter use) are available.
- whywhywhywhy 3y ago4090 is what it should be compared to, that's the equivalent card you'd be looking at for those workflows.