7 ms·
Silicon Brain: 100,000 ARM cores [video]
- rasz_pl 11y agoCustom 18 core arm chips (too much for A7-9, too little for M0-4, really weird number of cores), and what looks like 8-12 layer pcbs. This cant be cheap :o I wonder how it looks at this level of integration (850 cores per board) versus something like Xeon + PHI/GPU. You certainly do gain asynchronous mode of operation, and that might be the winning factor/secret sauce.
- ris 11y ago"Custom 18 core arm chips (too much for A7-9, too little for M0-4, really weird number of cores)" Could just look at the website instead of speculating http://apt.cs.manchester.ac.uk/projects/SpiNNaker/SpiNNchip/ http://apt.cs.manchester.ac.uk/projects/SpiNNaker/SpiNNchip/
- rasz_pl 11y agoARM9E, wow that is ancient, 15 year old nintendo DS ancient. Not even R4 (if they really really need realtime oriented core).
- m_mueller 11y agoAFAIK the Xeon Phi is based on something in between Pentium I and II cores. So the idea is about the same. I'd put my money on ARM when it comes to efficient chip architecture, since efficiency was their goal from the start (x86 was always about backwards compatibility first).
- DiabloD3 11y agoNo, the Phi is a P6 core, but so is all the modern Core family CPUs. All Phis are along the lines of modern cores stripped down and simplified. This is also how the modern Avoton and newer Atoms work, but the Phi is stripped down even farther.
- m_mueller 11y agoThat's not what I get from Intel's documentation. Intel seems to call it a Pentium I with a P6 programming interface. But maybe you have other sources, if so please share. > So why not use an older, smaller but still very capable core? And that is what they did. The designers went back generations, literally back to one of the first modern cores, the Intel® Pentium® processor. [1] > The foundation for the Intel® Xeon Phi™ coprocessor core PMU is the PMU from the original Intel® Pentium® processor (aka P54C). Most of the forty - two performance events that were available in the original Intel® Pentium® processor are also available on the Intel® Xeon Phi™ coprocessor The core PMU has been upgraded to an Intel® Pentium® Pro processor - like (“P6 - style”) programming interface. [1] https://software.intel.com/en-us/blogs/2013/03/22/the-intel-xeon-phi-coprocessor-what-is-it-and-why-should-i-care-pt-1-fitting-it-all https://software.intel.com/en-us/blogs/2013/03/22/the-intel-... [2] https://software.intel.com/sites/default/files/forum/278102/intelr-xeon-phitm-pmu-rev1.01.pdf https://software.intel.com/sites/default/files/forum/278102/... (section 1.2)
- DiabloD3 11y agoAll a PMU is, is a performance monitoring unit. It keeps track of CPU utilization and performance counters. This is an extremely small part of the CPU, and yes, I can imagine they jettisoned a lot of stuff you find on modern cores because it takes up too much room.
- m_mueller 11y agoGood point, that source wasn't really what I thought it is. There's still enough sources to support my argument though. > The cores at the heart of Intel’s first Xeon Phi are based on the P54C revision of the original Pentium and appear largely unchanged from the design Intel planned to use for Larrabee. [3] > Many changes were made to the original 32-bit P54c architecture to make it into an Intel Xeon Phi 64-bit processor. [4] - so, still, they seemed to have started with Pentium I and adding stuff to it rather than stripping out a modern core. Which was always the story they sold about Larrabee, which AFAIK was the direct predecessor project that got salvaged with Intel MIC. [3] http://www.extremetech.com/extreme/133541-intels-64-core-champion-in-depth-on-xeon-phi http://www.extremetech.com/extreme/133541-intels-64-core-cha... [4] https://software.intel.com/en-us/articles/intel-xeon-phi-core-micro-architecture https://software.intel.com/en-us/articles/intel-xeon-phi-cor...
- aidenn0 11y agoTaped out in in 2010 before the r4 was announced.
- etrautmann 11y agoThe human brain project did receive $1B from the EU...: https://en.wikipedia.org/wiki/Human_Brain_Project https://en.wikipedia.org/wiki/Human_Brain_Project
- yigitdemirag 11y agoFor those who interested in the hardware implementation of neural networks, this project simulates neurons on the software level, however neuromorphic TrueNorth chip does the same job on hardware level which enable faster and more efficient applications.
- nosideeffects 11y agoHowever, depending on how flexibly you can program it, it may not be quite as useful.
- kevinchen 11y agoSide note, hardware accelerated doesn't necessarily mean it's faster. For example, Java chips never took off because an x86 with a really good JIT does the job better. https://en.wikipedia.org/wiki/Java_processor https://en.wikipedia.org/wiki/Java_processor
- tinco 11y agoIt's cool that they compare it to mice brains and fractions of human brains, but how similar are they really? Do they operate at the same speed? I'd guess biological neurons trigger slower. Are they as connected? It's nice that it's a hexagonal mapping of a toroids surface, but neurons are connected in true 3d, how much more connected is that?
- TeeWEE 11y agoThe software still models a full network, the hardware has a different network topology.
- icoder 11y agoI still think interconnectedness may well be the bottleneck in mimicking a true brain, and its behaviour.
- trhway 11y ago>but neurons are connected in true 3d, not exactly. The most of the "thinking" neurons form the surface of the brain - that surface is wrinkled into "gyri" to achieve more than 2D, yet it isn't 3D. In the language of Hausdorff dimension it is 2.x something. And the neuron connections are pretty structured topology that is far from each-to-each. If, for example, you look at this picture https://en.wikipedia.org/wiki/Fornix_%28neuroanatomy%29#/media/File:Gray747.png https://en.wikipedia.org/wiki/Fornix_%28neuroanatomy%29#/med... you can see how the wires from the neurons of the hippocampus gyrus are bundled together into the "fimbria" and routed through the "fornix".
- redcalx 11y agoHere's a very short video showing white fibre bundles in a human brain. https://youtu.be/6YFG5OnDp-Y https://youtu.be/6YFG5OnDp-Y From: http://heliosphan.org/pittsburghbraincomp.html http://heliosphan.org/pittsburghbraincomp.html
- stefantalpalaru 11y agoThere are connections between all the cortical layers. See the description of cortical columns: http://brain.oxfordjournals.org/content/brain/120/4/701.full.pdf http://brain.oxfordjournals.org/content/brain/120/4/701.full...
- cpplinuxdude 11y ago"with a little bit of mathematics too" how wonderfully understated.
- grondilu 11y agoHe actually said "with quite a lot of mathematics too"
- Patient0 11y agoTitle should say 1 million ARM cores
- netfire 11y agoThat is the video title on Youtube and is the goal of the project, but the video itself shows a 100K ARM cores machine, not a million.
- melling 11y agoSounds like something Paul Allen's Brain Institute is working on. http://youtu.be/Te-SDsb6sHM http://youtu.be/Te-SDsb6sHM http://youtu.be/EX7wzqAoeQA http://youtu.be/EX7wzqAoeQA https://en.m.wikipedia.org/wiki/Allen_Institute_for_Brain_Science https://en.m.wikipedia.org/wiki/Allen_Institute_for_Brain_Sc...
- deleted 11y ago[deleted]
- deleted 11y ago[deleted]
- nodesocket 11y agoHow do the PCB boards communicate among themselves? The cables don't look like ethernet (CAT6).
- cobrabyte 11y agoThey almost look like SATA cables... not sure though.
- cma 11y agoCould be infiniband
- lcr 11y agoFrom the SpiNNaker project page: >The control interface is two 100Mbps Ethernet connections, one for the Board Management Processor and the second for the SpiNNaker array. There are options to use the six on-board 3.1Gbps high-speed serial interfaces (using SATA cables, but not necessarily the SATA protocol) for I/O...
- justin_ 11y ago"With a million cores we only get to about 1% of the scale of the human brain" Interesting. So in terms of raw computing power, the totality of computers out there is much more powerful than a brain. I wonder when we first passed that level as a whole. (I know that we wouldn't use all our computers to make a "brain", but I think it's interesting to think about :)
- bch 11y ago> I know that we wouldn't use all our computers to make a "brain", but I think it's interesting to think about Instead of SETI@home [0], SAI@home (search for artificial intelligence) ? [0] setiathome.ssl.berkeley.edu/
- etrautmann 11y agoBut the capabilities don't scale that way and the interconnect and topology of how that computation is arranged is completely different between brains and existing networks.
- xixixao 11y agoThis is a very inaccurate comparison for many reasons, but to get the sense of complexity of the human brain: In the human brain, there are almost 100 billion neurons (the project plans to simulate 1000 neurons on one core, hence 1% atm). Each has about 7000 connections, or alternatively there are estimated 10^15 connections or more. The internet has only about 15-20 billion nodes, only few highly connected, the Internet is more of a tree than a complete mesh. So in some way, you could say we are nowhere close to obtaining the computing power of the brain, if we, of course, disregard the fact that the nodes, computers, are very powerful on their own. But this is where the comparison breaks. The human brain is powerful due to the complexity of its network, not the sheer amount of "working units" (cores/transistors). Comment on the project: it is exciting, but it must not be understated that it is still a very gross approximation, since the neuron models used are simple. It might be the case that interesting behavior will arise using this simple model, but it also might be the case that the secret sauce is in the fine behavior of each neuron. The hope is that interesting phenomena can be observed with this simpler model, perhaps a bit like classical physics can often be used without requiring the full model of quantum mechanics.
- bch 11y agoI wonder what software they're using; they mention that the system is event-driven, but I can't see any sign of what they're using to implement this, whether custom or COTS software...
- transfire 11y agoDoubling every two years, we will have brain power in a single rack in 13 years, and a brain sized box in less than 20.
- mentos 11y agoWhat technology do we have right now to map the connections of the brain? Is there anything that currently exists with enough granularity to take a snapshot of our neurons and their connections? edit: thanks for the replies, did some research found this TED talk that visualizes the problem pretty well https://www.youtube.com/watch?v=HA7GwKXfJB0 https://www.youtube.com/watch?v=HA7GwKXfJB0
- yigitdemirag 11y agofMRI I suppose. As far as I know, even if you have all neuron mapping of human brain, you could not achieve basic intelligence as brain constantly alter with these connections and their strengths. Even if you know all the connections, neuron firing types and representation of information over the network would create a big question for you.
- mentos 11y agoYea if you think about it short term memory is necessary for the movement of consciousness from state to state. Otherwise it'd be like flipping a toaster on.
- bertil 11y agoThe MIT & Harvard medical school and CS had a joint project called something like the Brain initiative to collect that combining results from: - inferences of neuron interactions from electronic wiring individual neurons in mice brains; - fMRI and tFMI (a mathematical extension that associates area that are activated one after the other) on live humans; - scanning ultra-thin slices (volunteer human brain donor) and using that for an neuron-to-synapse complete map of at least one brain. Both the slicing technology and the AI to re-combine images into not just a 3D model, but a complete connectron are pretty mind-blowing achievements. If you combine that to the possible impact in AI and medical learnings on how things like degenerescence, you can imagine why it ends up feeling far more ambitious than the Manhattan project.
- ropiku 11y agoThere's also a video of wiring the rack (took 4h) and how the wiring for the whole 10-rack cluster would look like: http://jhnet.co.uk/projects/spinner http://jhnet.co.uk/projects/spinner
- dharma1 11y agopretty cool dude. https://en.wikipedia.org/wiki/Steve_Furber https://en.wikipedia.org/wiki/Steve_Furber