6 ms·
Nvidia Jetson Orin Nano Super [video]
- jbverschoor 2y agoGood response to Apple silicon eating dev llm. Bc dev is the first step to domination
- AlexeyBrin 2y agoNot really comparable, Apple Silicon is not an embeddable device as the Jetson series is meant to be. And the Jetson will never replace an Apple laptop or even a MacMini for regular users.
- jbverschoor 2y agoSure, but it’s a small desktop device, popular for development
- talldayo 2y agoThis isn't a response at all. Nvidia has been making Jetson boards for longer than Apple has been making their own chips.
- kube-system 2y agoLonger than Apple has made desktop chips, yes.
- jbverschoor 2y agoNot everybody wants a huge noisy hot and energy slurping device on their desk
- deleted 2y ago[deleted]
- Jiahang 2y agoAnother new toy in the Jetson series, the wallet shows that it is very painful.
- nadermx 2y ago"NVIDIA Ampere architecture with 1024 CUDA cores and 32 tensor cores" from their site. Not sure I understand how many Gigs of gpu memory that is?
- zamadatix 2y agoThat's the number of processing cores. Memory is 8 GB of LPDDR5 at 102 GB/s. Datasheet here: https://nvdam.widen.net/s/zkfqjmtds2/jetson-orin-datasheet-nano-developer-kit-3575392-r2 https://nvdam.widen.net/s/zkfqjmtds2/jetson-orin-datasheet-n... 50% of the performance increase seems to come from the memory bandwidth increase and the other 20% from the extra 10 Watts to boost clocks with (15W -> 25W).
- AlexeyBrin 2y agoThe price is interesting. What I don't like about these devices is that they are supported for a few years and after you are on your on. I have the original Jetson Nano and they stopped providing any updates for it, if you can use it without an internet connection it will work just fine for years.
- vanillax 2y agoYup and trying to hack your OG jetson Nano to a later linux is very hard due to proprietary linux / nvidia firmware/drivers. Its not a matter of your are on your own for OS upgrades, it straight up wont even be able to use the GPU for cuda. Pretty annoying.
- aseipp 2y agoI think the latest Orin series supports both UEFI and there is "Bring Your Own Kernel" support for more recent releases[1], but you still need to apply the patches. Also, the Tegra GPU driver "nvgpu" has been open source in this form for quite some time in the Linux4Tegra tree, but I don't see it in the patch list. So, it's still a bit of a mixed bag, I think. But UEFI and 6.x kernel support is at least an improvement... [1] https://docs.nvidia.com/jetson/archives/r36.3/DeveloperGuide/SD/Kernel/BringYourOwnKernel.html#upstream-patches https://docs.nvidia.com/jetson/archives/r36.3/DeveloperGuide...
- PhilippGille 2y agoApparently they differentiate between their regular modules and the dev kits: The Jetson Nano you mentioned is supported until 2027, but their dev kit is EOL. For the Jetson Orin Nano the module is supported until 2032, but the dev kit likely not. Source: https://developer.nvidia.com/embedded/lifecycle https://developer.nvidia.com/embedded/lifecycle
- numpad0 2y agoWell, that's how embedded computers are meant to be used, just like everything before the Internet.
- hemogloben 2y agoThe specs on this look identical to the Orin Nano 8GB. Elsewhere Nvidia says the software updates are available to all Orin owners [1], so is this just a special edition released alongside the new JetPack release? 1: https://blogs.nvidia.com/blog/jetson-generative-ai-supercomputer/ https://blogs.nvidia.com/blog/jetson-generative-ai-supercomp...
- kcb 2y agoLooks like just higher clock speeds and faster memory. An upgrade to 16GB would've been cool.
- HowardStark 2y agoThe Orin NX is 16GB. My guess would be they still want some differentiation
- ZiiS 2y agoI do wonder if he is simply gaming the Turing test now?
- zamadatix 2y agoEven with the lower price point it's still a bit of an odd fit. The dev kit is aimed at developers but costs about the same as a 3060 (which will blow it out of the water on AI performance and capacity). Unless this board was already the one you were targeting for non-development usage for your robotics/embedded edge use case then I'm not sure there is a compelling reason to be interested in the announcement. Edit: I didn't mean to imply it's a bad use case or product, just that it's not a use case 95% here are going to care about. It's an odd fit but if you're the target of that fit it's great. If you're not that odd fit target, don't get your hopes up about a low cost AI dev kit from Nvidia. It'll just be another SBC sitting unused in your drawer.
- Retr0id 2y agoYou can't put a 3060 in a smaller-than-large robot
- zamadatix 2y agoThis is what I mean by "unless this board was already the one you were targeting for non-development usage for your robotics/embedded edge use case". If you're planning on using this board already then sure, you want this dev board update. If you're not that use case of that niche then this announcement will probably not be worth looking in to.
- taneq 2y ago(a) Dev kits are often much more expensive than the production hardware. (b) Why would you even care about this if a desktop gaming gpu would work for you? It’s an embedded inference module.
- zamadatix 2y agoI meant to highlight, though apparently did poorly, 95% of people here will fall into (b) as it's not aimed at being the general use AI dev kit they'd want it to be. Unfortunately that seems to have been taken as "the product is useless to those building embedded systems because you can buy a 3060" due to my unclear wording.
- PhilippGille 2y agoVideo description links to this URL: https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-orin/nano-super-developer-kit/ https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
- deleted 2y ago[deleted]
- kittikitti 2y agoI appreciated this release including the personal video from the CEO with an oven joke. Although the VRAM is very limited, these specifications compete with Raspberry Pi's platform and I would expect the Orin Nano Super to outperform.
- TechDebtDevin 2y agoWas literally about to buy the Jetson Orin Nano for $499 and then this gets to released. How awesome
- sliken 2y agoI've been looking for a replacement for Google Assistant/Nest/Nest Mini that is cloudless and could support things like verbally setting alarms, inquiring about the weather, and random queries. This looks like a decent fit. Just needs a case, microphone, and speaker. Oh an one of the newer small LLMs that fit in under 8GB.
- snapplebobapple 2y agoYou probably want to wait a few months to a year for this: https://futureproofhomes.net/ https://futureproofhomes.net/ They will have a local llm module within a year too I think.
- sliken 2y agoVery interesting. I'll keep an eye out. This is one I've been tracking as well: https://news.ycombinator.com/item?id=40744293 https://news.ycombinator.com/item?id=40744293
- nimish 2y agoIf anyone is wondering why nVidia is dominant, it's because this guy can run the same CUDA stuff as the $30000 H100 So everyone can play around and develop for it. That's how you get to software dominance, and then can reap the rewards.
- downrightmike 2y agoThe new Java
- jeanlucas 2y agoIf it really is the new Java they will surf this wave for 20 years at least
- downrightmike 2y agoCuda came out in 2007, 2 years to go
- m463 2y agojava: write once, test everywhere
- bradfa 2y agoIt appears to be the same hardware as before, even the same firwmare/software as before (JetPack 6.1 was already out), just now they've lowered the dev kit price and documented a new performance mode which increases the clocks, power consumption, thermals, and compute performance.
- croes 2y agoYou can flash the new firmware on the previous versions to get the same benefits
- deleted 2y ago[deleted]
- haunter 2y agoWhat OSes can be run on this? I've seen people using Ubuntu and Debian but sounds like bascially anything that has an ARM64 version? What about BSD (ignoring CUDA)?
- qwertox 2y agoFor most of us this is not so attractive. The 8GB shared RAM are all there is for OS + models, so the current Jetson AGX Orin 64GB is still more interesting as it allows to run a small LLM plus ASR and TTS on one device, yet with a price tag above 2000€ and also with an Ampere GPU but at 275 TOPS. But for vision / robotics stuff this Nano Super is a great price. You can search for "View Jetson Orin Technical Specifications" on the Jetson Orin page [0] to see the full offering of devices (it's in the middle of the page). [0] https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-orin/ https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
- alecco 2y agoI really like CUDA, but these are crazy expensive for the specs. It's sad there is no competition.
- ksec 2y agoAm I correct to assume this is the same SoC as the upcoming Switch 2?
- snapplebobapple 2y agoWhat do you guys recommend for a case for this? rank mountable would be useful but a base I can sit on a shelf in a rack would work too.
- awwaiid 2y agoAny guesses on using this for LLM inference how it compares performance-wise (like tokens/sec ultimately) to like the new mac mini m4pro? I'm not sure how to figure that out.
- tonymet 2y agois it really that hard to add a sodimm slot.