3 ms·
Nvidia announces $3k personal AI supercomputer called Digits
- vinni2 2y agoDUPE https://news.ycombinator.com/item?id=42619139 https://news.ycombinator.com/item?id=42619139
- deleted 2y ago[deleted]
- neom 2y agoIn case you're curious, I googled. It runs this thing called "DGX OS": "DGX OS 6 Features The following are the key features of DGX OS Release 6: Based on Ubuntu 22.04 with the latest long-term Linux kernel version 5.15 for the recent hardware and security updates and updates to software packages, such as Python and GCC. Includes the NVIDIA-optimized Linux kernel, which supports GPU Direct Storage (GDS) without additional patches. Provides access to all NVIDIA GPU driver branches and CUDA toolkit versions. Uses the Ubuntu OFED by default with the option to install NVIDIA OFED for additional features. Supports Secure Boot (requires Ubuntu OFED). Supports DGX H100/H200."
- danieljanes 2y agoNot having to install CUDA is a killer feature, looking forward to DGX OS
- angoragoats 2y agoIs this sarcasm, or is installing CUDA really a problem for most people? I use NixOS and set it up once a long time ago, and never have to think about it, even for new installs.
- throw5959 2y agoUnfortunately, most people still don't know Docker, much less NixOS.
- angoragoats 2y agoOkay, but I'm genuinely asking -- it can't be that bad on e.g. Ubuntu, right? Just install a package and you're done?
- schmookeeg 2y agoI think some problems arise when you use some 5 year old "install CUDA" blog instead of the official docs. You can get sent down some messy rabbit holes and dependency loops that way. Ask how I know :)
- lionkor 2y agoIf I buy one, do I get the Nvidia optimized kernel source under GPL?
- verdverm 2y agosuper computer seems a bit exaggerated, seems more like workstation in a small box
- paxys 2y agoJust marketing nonsense. In the same keynote Jensen called it an “AI supercomputer” and “cloud computing platform”. Might as well add “quantum blockchain computer” while you are at it.
- anthonyskipper 2y agoI think they say that because it used to be only supercomputers that could do a petaflop of compute. So taking what used to be a datacenter(15 years ago) and cramming it into a small device is a pretty impressive feat.
- deleted 2y ago[deleted]
- pelagicAustral 2y agoI assume I can finally play Crysis
- karim79 2y agoI recently picked up a NVidia Jetson Orin NX developer kit (16GB, 100 TOPS) and it performs admirably well on inference at <= 40W power draw. Would love to get my hands on one of these things.
- glimshe 2y agoDepending on your definition of "Supercomputer", every phone is a personal Supercomputer. They are faster than big iron Supercomputers of not that many years ago...
- throw5959 2y agoIt was always relative to contemporary computers, though yes, I also say "let me consult the AI in my pocket supercomputer". Feels very Star Trek.
- analognoise 2y agoOnly if the AI on your pocket supercomputer gets the right answer. If it fails to tell you how many R’s are in “strawberry” I doubt it will help you come up with correct orbital mechanics to slingshot you around a black hole to escape the Romulans who just uncloaked nearby.
- throw5959 2y agoFunnily enough, the AI on my phone gives better answers to hard questions about astrophysics than the basic word puzzles you mention. It's just a different kind of intelligence, I guess. I'm not asking it to do the calculations, I'm asking it to give me the formula and prove it's correct. The rest will come soon.
- apexalpha 2y agoAnyone know the Wattage this will pull? Assuming the CPU is just ARM it should run pretty decently low on idle, might work for a homeserver.
- mdavidn 2y agoIf you need an LLM on your home server, sure. If not, there are much more sensible home server options based on Intel’s N100 or Microsoft’s SQ3 chipsets.
- apexalpha 2y agoYeah I do need the LLM. Currently running 2 old Tesla M40's for 48GB of VRAM. While cheaper than this it has its limitations. Running a 200B model locally is very attractive though. Excited for the future.
- makestuff 2y agoWhat do the 5xxx series cards have that this doesn't which makes them use way more power and need massive coolers? I have a feeling the software workflows will not run as well as the marketing claims, but the idea is really interesting and in a few years I bet the workflow will be really smooth.
- hank808 2y agoThe NIC that has matters, in addition to the very large memory that supports much larger models than a consumer GPU. This thing has a proper ConnectX NIC.
- cma 2y agoWay more memory bandwidth and performance (GDDR7 vs LPDDR5). I didn't see fp32 detailed, but this may be more focused on low precision. This is probably closer to quad-channel threadripper/second tier apple levels of bandwidth than to modern GPU bandwidth, but maybe it gets up to 800GB/s like the M1 Ultra. 5090 is 1.8GB/s, four of them for the same amount of RAM (3X as expensive with a system), would be 7200GB/s, maybe 10-20X more. With the lower power consumption, if this has full performance FP32, it may be pretty killer though for home use, especially if the bandwidth of the ConnectX is more than thunderbolt 5.
- cma 2y agoEdit: LPDDR5X, I think that's 30% faster
- cma 2y agoWhat's the bandwidth of the ConnectX interface?
- numba888 2y agoSupper or not, it's way better for AI load then 4090 or 5090 set. And cheaper. I'm getting one instead of 5090 I wanted.
- helf 2y ago[dead]