3 ms·
Nvidia sell iot boards with unified architecture. Would not be shocked if they launch pc/laptop/server boards at some point.
by pletnes 2mo ago
Nvidia sell iot boards with unified architecture. Would not be shocked if they launch pc/laptop/server boards at some point.
- synergy20 2mo agothat undercuts their core business, so it will be a defensive play at most to fend off mac and amd's local inference offerings
- bigyabai 2mo agoI don't know how people can say this with a straight face. Nvidia was selling desktop-grade ARM SOCs before Apple Silicon was ever announced, specifically for edge robotics, computer vision and ML. The absolute fastest desktop Mac GPUs cannot beat an Nvidia laptop GPU in prefill or inference speeds. Apple Silicon is a non-entity for professional datacenter deployment and arguably unusable for frontier models at agentic context sizes. AMD is Nvidia's primary worry, and they're not doing much better in terms of GPGPU SOC compute.
- officeplant 2mo ago>Nvidia was selling desktop-grade ARM SOCs before Apple Silicon was ever announced You can believe all you want that the dinky little jetson boards were desktop grade when historically the ARM SoC portion of a jetson board couldn't even keep up with broadcom/rockchip SoCs. It's taken until recently for the actual arm compute portion of Nvidia SoC's to be worth a damn at all, and they still fall far behind Apple let alone the rest of the pack like Qualcomm/Samsung.
- bigyabai 2mo agoI don't have to believe. I've run KDE and GNOME on the Tegra boards, you get full-fat CUDA support without sacrificing Vulkan drivers. It's incredible. You can believe all you want that good single-core performance will corner the edge compute market. It hasn't, Graviton has more buy-in than any Apple Silicon chip ever got.
- HDThoreaun 2mo agoEvery time nvidia takes its fab time and uses it to build anything other than datacenter chips it is losing money due to the massive markups the datacenter products have. Expanding their consumer offering means the datacenter backlog is going down which is very bad for their margins. Consumers will never pay 10-100x what it costs to fab something like datacenter users will.
- bigyabai 2mo agoIn many cases it isn't Nvidia paying for the fab time. For instance, the Nintendo Switch 2 is basically a pure-play design and support product for Nvidia, while Nintendo negotiates with Samsung for the actual SOC prices. Their IP philosophy is closer to AMD's than Apple's, Nvidia has long roped in 3rd party manufacturers to mark up, integrate and sell their hardware.
- wmf 2mo agoRTX Spark already launched.
- buildbot 2mo agoUnified memory DGX Spark and RTX Spark laptops are already a thing :)
- leoc 2mo agoRight, it's clear that nVidia is taking care and trying to position itself so that it can continue making sales if and when inference goes local. And it's in a much better intrinsic position to do that than the LLM SaaS vendors are: nVidia sells shovels to the army, but it also knows how to sell shovels to Walmart. Whether the financial relationships that Huang's got his company into will cause it problems if the market shifts is a different question, though.
- FuriouslyAdrift 2mo agoAs is AMD Strix Point
- ABS 2mo agoAFAIK NVIDIA unified memory is not as... "unified" as Apple's
- wslh 2mo agoYes. The more capable SoC PCs become, the weaker the "everything has to run in the datacenter" argument gets. As more powerful SoC PCs from multiple vendors appear over the next few years, that advantage may shrink for many workloads.
- ragall 2mo agoI'd be happy enough if Nvidia decided to launch an update to the now dated (2019) Shield streaming box, which is still the best on the market as to codec support and image quality.