12 ms·
Sandia turns on brain-like storage-free supercomputer
- pier25 1y agoImagine if this is actually Skynet and the apocalyptic AI is called Sandia instead :) (Sandia means watermelon in Spanish)
- m463 1y agoWhen I first learned that, the prestigious-sounding "sandia national labs" became "watermelon national labs" and I couldn't help but laugh.
- realo 1y agoNo storage? Wow! Oh... 138240 Terabytes of RAM. Ok.
- jonplackett 1y agoJust don’t turn it off I guess…
- rzzzt 1y agoI hear Georges Leclanché is getting close to a sort of electro-chemical discovery for this conundrum.
- rbanffy 1y agoAt least not while it's computing something. It should be fine to turn it off after whatever results have been transferred to other computer.
- throwaway5752 1y agoI feel like there is a straightforward biological analogue for this. But at in this case, one wouldn't subject to macro-scale nonlinear effects arising from the uncertainty principle when trying to "restore" the system.
- crtasm 1y ago>In Sandia’s case, it has taken delivery of a 24 board, 175,000 core system So a paltry 2,304 GB RAM
- SbEpUBz2 1y agoI am reading it wrong, or the math doesn't add up? Shouldn't it be 138240 GB not 138240 TB?
- divbzero 1y agoYou’re right, OP got the math wrong. It should be: 1,440 boards × 96 GB/board = 138,240 GB
- CamperBob2 1y agoEither way, that doesn't exactly sound like a "storage-free" solution to me.
- louthy 1y agoJust whatever you do, don't turn it off!
- Nevermark 1y ago"What does this button do?" Bmmmfff. On the TRS-80 Model III, the reset button was a bright red recessed square to the right of the attached keyboard. It was irresistible to anyone who had no idea what you were doing as you worked, lost in the flow, insensitive to the presence of another human being, until... -- Then there was the Kaypro. Many of their systems had a bug, software or hardware, that would occasionally cause an unplanned reset the first time, after you turned it on, that you tried writing to the disk. Exactly the wrong moment.
- DonHopkins 1y agoOh, the Apple ][ reset button beat the TRS-80 Model III "hands down" many years earlier, with its "Big Beautiful Reset Button" on the upper right corner of the keyboard. It was comically vulnerable -- just begging to be pressed. The early models had one so soft and easy to trigger that your cat could reboot your Apple ][ with a single curious paw. Later revisions stiffened the spring a bit, but it was still a menace. There was a whole cottage industry aftermarket of defensive accessories: plastic shields that slid over the reset key, mail-order kits to reroute it through an auxiliary switch, or firmware mods to require CTRL-RESET. You’d find those in the classified ads in Nibble or Apple Orchard magazines, nestled between ASCII art of wizards and promises to triple your RAM. Because nothing says "I live dangerously" like writing your 6502 assembly in memory with the mini assembler without saving, then letting your little brother near the keyboard. I got sweet sweet revenge by writing a "Flakey Keyboard Simulator" in assembly that hooked into the keyboard input vector, that drove him bonkers by occasionally missing, mistyping, and repeating keystrokes, indistinguishable from a real flakey keyboard or drunk typist.
- Footpost 1y agoWell since Neuromorphic methods can show that 138240 = 0, should it come as as surprise that they enable blockchain on Mars? https://cointelegraph.com/news/neuromorphic-computing-breakthrough-enable-blockchain-mars https://cointelegraph.com/news/neuromorphic-computing-breakt...
- dekhn 1y agoThe article hides the truth which is that it has no direct attached durable storage, but is connected via a Fabric to existing HPC hardware, which almost certainly loads data to the Spinnaker and stores results. At the end of the day, processors really just load data, process, and store back to durable data (or generate some visible side effect).
- shrubble 1y agoYou don’t have to write anything down if you can keep it in your memory…
- timmg 1y agoDoesn't give a lot of information about what this is for or how it works :/
- throawayonthe 1y ago> Hector A. Gonzalez, co-founder and CEO of SpiNNcloud, said the system would be targeted at problems in “next generation defense and beyond. The SpiNNaker2’s efficiency gains make it particularly well-suited for the demanding computational needs of national security applications.” :(
- fasteddie31003 1y agoHow much did this cost? I'd rather have CUDA cores.
- rbanffy 1y agoPart of their job is to evaluate novel technologies. I find this quite exciting. CUDA is well understood. This is not.
- fintler 1y agoThey already have CUDA cores in production. This is a lab that's looking for the next big thing.
- bee_rider 1y agoSandia’s business model is different from NVIDIA for sure.
- curtisszmania 1y ago[dead]
- dedicate 1y agoI feel like we're just trading one bottleneck for another here. So instead of slow storage, we now have a system that's hyper-sensitive to any interruption and probably requires a dedicated power plant to run. Cool experiment, but is this actually a practical path forward or just a dead end with a great headline? Someone convince me I'm wrong...
- JumpCrisscross 1y ago> we're just trading one bottleneck for another If you have two systems with opposite bottlenecks you can build a composite system with the bottlenecks reduced.
- moralestapia 1y agoUsually, you get a state with two bottlenecks ...
- rzzzt 1y agoThink of L2 cache (small access time, small capacity) vs. memory modules (larger access time, large capacity) on a motherboard. You get the large capacity and an access time somewhere in between, depending on the hit rate.
- moralestapia 1y ago>depending on the hit rate Yes, a different usage pattern could give you the worse of both worlds. That's a very deep insight from queue theory and similar topics, I don't know if you wrote what you wrote with that in mind (I'm not being an ass, I just want to highlight this observation). A system's behavior is highly dependent, to the point of it being fundamental, on how it is going to be used.
- DonHopkins 1y agoSounds like you need a massively parallel hardware regexp accelerator (a RePU), so you can have two millions of problems!
- isoprophlex 1y ago> the SpiNNaker 2’s highly parallel architecture has 48 SpiNNaker 2 chips per server board, each of which in turn carries 152 based cores and specialized accelerators. NVIDIA step up your game. Now I want to run stuff on based cores.
- marsten 1y agoInteresting that they converged on a memory/network architecture similar to a rack of GPUs. - 152 cores per chip, equivalent to ~128 CUDA cores per SM - per-chip SRAM (20 MB) equivalent to SM high-speed shared memory - per-board DRAM (96 GB across 48 chips) equivalent to GPU global memory - boards networked together with something akin to NVLink I wonder if they use HBM for the DRAM, or do anything like coalescing memory accesses.
- patcon 1y agoWhenever I hear about neuromorphic computing, I think about the guy who wrote this article, who was working in the field: Thermodynamic Computing https://knowm.org/thermodynamic-computing/ https://knowm.org/thermodynamic-computing/ It's the most high-influence, low-exposure essay I've ever read. As far as I'm concerned, this dude is a silent prescient genius working quietly for DARPA, and I had a sneak peak into future science when I read it. It's affected my thinking and trajectory for the past 8 years
- evolextra 1y agoMan, this article is incredible. So many ideas resonate with me, but I never can't formulate them. Thanks for sharing, all my friends have to read this.
- epsilonic 1y agoIf you like this article, you’ll probably enjoy reading most publications from the Santa Fe Institute.
- afarah1 1y agoInteresting read, more so than the OP. Thank you.
- iczero 1y agoIsn't this just simulated annealing in hardware attached to a grandiose restatement of the second law of thermodynamics?
- pclmulqdq 1y agoYes. This keeps showing up in hardware engineering labs, and never holds up in real tasks.
- moralestapia 1y ago[flagged]
- HarHarVeryFunny 1y agoThe original intent for this architecture was for modelling large spiking neural networks in real-time, although the hardware is really not that specialized - basically a bunch of ARM chips with high speed interconnect for message passing. It's interesting that the article doesn't say that's what it's actually going to be used for - just event driven (message passing) simulations, with application to defense.
- Onavo 1y agoProbably Ising models, phase transitions, condense matter stuff all to help make a bigger boom.
- colordrops 1y ago> this work will explore how neuromorphic computing can be leveraged for the nation’s nuclear deterrence missions. Wasn't that the plot of the movie War Games?
- bob1029 1y agoI question how viable these architectures are when considering that accurate simulation of a spiking neural network requires maintaining strict causality between spikes. If you don't handle effects in precisely the correct order, the simulation will be more about architecture, network topology and how race conditions resolve. We need to simulate the behavior of a spike preceding another spike in exactly the right way, or things like STDP will wildly misfire. The "online learning" promise land will turn into a slip & slide. A priority queue using a quaternary min-heap implementation is approximately the fastest way I've found to serialize spikes on typical hardware. This obviously isn't how it works in biology, but we are trying to simulate biology on a different substrate so we must make some compromises. I wouldn't argue that you couldn't achieve wild success in a distributed & more non-deterministic architecture, but I think it is a very difficult battle that should be fought after winning some easier ones.
- mycall 1y agoArtem Kirsanov provides some insights into the neurochemistry and types of neurons in his latest analysis [0] of distinct synaptic plasticity rules that operate across dendritic compartments. When simulating neurons in a more realistic approach, the timing can be deterministic. [0] https://www.youtube.com/watch?v=9StHNcGs-JM https://www.youtube.com/watch?v=9StHNcGs-JM
- BriggyDwiggs42 1y agoOh I adore this channel. An absolute gem.
- Joel_Mckay 1y agoMany Neuromorphic computing platforms are robust at handling Globally asynchronous locally synchronous solver hardware. There are some counterintuitive design choices that emerge, and it inevitably leads to vector machines with arbitrary order Tensor capabilities. Have a wonderful day =)
- rahen 1y agoSo if I understand correctly, the hardware paradigm is shifting to align with the now-dominant neural-based software model. This marks a major shift, from the traditional CPU + OS + UI stack to a fully neural-based architecture. Am I getting this right?
- GregarianChild 1y agoI'd be interested to learn who paid for this machine! Did Sandia pay list price? Or did SpiNNcloud Systems give it to Sandia for free (or at least for a heavily subsidsed price)? I conjecture the latter. Maybe someone from Sandia is on the list here and can provide detail? SpiNNcloud Systems is known for making misleading claims, e.g. their home page https://spinncloud.com/ https://spinncloud.com/ lists DeepMind, DeepSeek, Meta and Microsoft as "Examples of algorithms already leveraging dynamic sparsity", giving the false impression that those companies use SpiNNcloud Systems machines, or the specific computer architecture SpiNNcloud Systems sells. Their claims about energy efficiency (like "78x more energy efficient than current GPUs") seem sketchy. How do they measure energy consumption and trade it off against compute capacities: e.g. a Raspberry Pi uses less absolute energy than a NVIDIA Blackwell but is this a meaningful comparison? I'd also like to know how to program this machine. Neuromorphic computers have so far been terribly difficult to program. E.g. have JAX, TensorFlow and PyTorch been ported to SpiNNaker 2? I doubt it.
- floren 1y agoAs an ex-employee (and I even did some HPC) I am not aware of any instances of Sandia receiving computing hardware for free.
- DonHopkins 1y agoDeep Mind (Google’s reinforcement learning lab), Deep Seek (Alibaba’s LLM initiative), Deep Crack (EFF’s DES cracker), Deep Blue (IBM’s chess computer), and Deep Thought (Douglas Adams’ universal brain) all set the stage... So naturally, this thing should be called Deep Spike, Deep Spin, Deep Discount, or -- given its storage-free design -- Deep Void. If it can accelerated nested 2D FORTRAN loops, you could even call it Deep DO DO, and the next deeper version would naturally be called Deep #2. JD Vance and Peter Thiel could gang up, think long and hard hard, go all in, and totally get behind vigorously pushing and fully funding a sexy supercomputer with more comfortably upholstered, luxuriously lubricated, passively penetrable cushioned seating than even a Cray-1, called Deep Couch. And the inevitable jealous break-up would be more fun to watch than the Musk-Trump Bromance!
- laidoffamazon 1y agoIf it doesn’t have an OS, how does it…run? Is it just connected to a host machine and used like a giant GPU?
- 2OEH8eoCRo0 1y agoHow does an OS "run"?
- deleted 1y ago[deleted]
- StressedDev 1y agoYou can run software on bare metal without an OS. The downside is you have to write everything. That means drivers, networking code, the process abstraction (if you need it), etc. One thing to remember is an operating system is just another computer program.
- laidoffamazon 1y agoAt that point, you'd call the software stack an OS and not declare it to not have an OS
- rbanffy 1y agoDo GPUs have OSs? Or is it the host computer that sets up memory with data and programs and starts the processing units running?
- mikewarot 1y agoI see "storage-free"... and then learn it still has RAM (which IS storage) ugh. John Von Neumann's concept of the instruction counter was great for the short run, but eventually we'll all learn it was a premature optimization. All those transistors tied up as RAM just waiting to be used most of the time, a huge waste. In the end, high speed computing will be done on an evolution of FPGAs, where everything is pipelined and parallel as heck.
- thyristan 1y agoFPGAs are implemented as tons of lookup-tables (LUTs). Basically a special kind of SRAM.
- mikewarot 1y agoThe thing about the LUT memory is that it's all accessed in parallel, not just a 64 bits at a time or so.
- thyristan 1y agoNot all, not always. FPGAs usually have more memory than is accessible in parallel (because memory cells are a lot cheaper than routing grid) and most customers want some blockram anyways. So what your synthesis tool will do with very high LUT usage is to do input or output multiplexing. Or even halving your effective clock and doubling your "number" of LUTs by doing multi-step lookups in then non-parallel memory.
- 1970-01-01 1y agoThe pessimist in me thinks someone will just use it to mine bitcoin after all the official research is completed.
- hackyhacky 1y agoThe title describes this machine as "brain-like" but the article doesn't support that conclusion. Why is it brain-like? I also don't understand why this machine is interesting. It has a lot of RAM.... ok, and? I could get a consumer-grade PC with a large amount of RAM (admittedly not quite as much), put my applications in a ramdisk, e.g. tmpfs, and get the same benefit. In short, what is the big deal?
- groby_b 1y agoCalling 138240 TB of DRAM "storage-free" is... impressive.
- rbanffy 1y agoIt's volatile storage. It needs to connect to other systems in order to operate.
- ChaoPrayaWave 1y ago[dead]
- anArbitraryOne 1y agoI love bio-inspired stuff, but can we (collectively) temper our usage of it? A better name for this would probably be something like distributed storage and computing architecture (or someone who really understands what this thing is please come up with a better name). If they want to say that part of the architecture is bio-inspired, or mammalian brain inspired, than fine, but let's be parsimonious
- 1Sebastian 1y ago[dead]
- latchkey 1y agoI was tasked with getting 20,000 PS5 APU's online. ASRock BC-250. Each chassis had 12 independent blades and in order to save money, we decided to not put SSD/NVMe into them and iPXE boot them instead. Each APU had 16GB of memory, but the only issue was that it wasn't ECC, so they would randomly fail. It took a lot of effort but it actually worked!