6 ms·
AI Needs Enormous Computing Power. Could Light-Based Chips Help?
- seanc 2y agoA wise person once said "Bosons are for transport and fermions are for switching."
- neon_me 2y agoplease, eli5 <3
- seanc 2y agoly5: The universe is made of two kinds of particles, Bosons and Fermions. Light is a boson. Most of the stuff we touch is made of Fermions. Electricity is fermions also. Bosons, like light, don't like to interact with things. They just want to go places, as fast as they possibly can. So if you want a particle to carry information from point A to point B, light is great. Point it in the right direction and off it goes, and it won't interact with anything unless it absolutely as to. Fermions, like electrons, love bumping into each other and changing each other. They like to make atoms and collide and bounce off each other all the time. So if you want to build a switch or a microchip where lots of things connect to each other to do some big complicated task like computing lots of math then electrons work really well. But if you try to get photons to dance together to do something complicated you'll have a hard time. They only interact with each other and the stuff around them when things are just right, and then only in limited ways. And if you try to use electrons to move data over any kind of distance that's hard too. They're constantly stopping to chat with atoms they find along the way, turning the energy of your message into heat. How's that?
- macilacilove 2y agoThere are bosons that carry charges and/or mass like the weak bosons and the gluons. There is nothing in principle about bosons that would make them incapable of building logic gates out of them. Some advanced civilization (future us) may use them. Even photons interact with each other a little bit due to QED.
- seanc 2y agoFor sure, you can if you want to. And if you pull it off there are some advantages, which the article describes. It's just harder.
- watt 2y agoI wonder if it's just harder for us, now. It used to be hard for humans to make fire: nowadays you have match stick or lighter technology to make fire just like that. I wonder if we as humanity will be able to build the technological harness around light just as well.
- tedajax 2y agoThere's also composite bosons like cooper pairs which are just made up of two electrons.
- FrustratedMonky 2y agoThat is nice. But then why do fiber optic cables work? The data does need to be turned into photons, and back from photons into electrons at some point. So all of that has switching and has been done for a long time. Guess maybe lot of people like me are wondering why the technology for fiber optic cables can't be scaled down further to be used on chips.
- JoeAltmaier 2y agoLatency? Takes time to make photons from electrons and vice versa. Folks try to step around this with light-driven gates. Lots to learn! Plenty out there!
- tempodox 2y agoThat's a fantastic explanation. +1.
- ardel95 2y agoIn quantum mechanics, bosons are (often massless) force carrying particles like photons or gluons. Fermions are the massive matter particles, such as electrons or quarks. So, while I’ve never heard this saying before, I assume it’s meaning is that massless particles like photons are best for carrying information around (rather than electrons we are using in circuits today), while the electrons are best for carrying state, like in a switch. Note, that in networking we have already made that transition by using fiber optics, rather than electric wire to transfer information over longer distances.
- seanc 2y agoAnd radio! We use lots of radio as well. I wonder what the longest information carrying electric wire is? They used to cross oceans, but not anymore. There are loads of DSL twisted pairs and co-ax cables in the "last mile" that maybe go 5km max. In rural areas maybe up to 50km with repeaters? Is there something in between? Some old buried copper trunk cable between two university campuses or something like that?
- ThrowawayTestr 2y agoDepending on your definition of wire, probably the earth. The first telegraph systems used the earth (or sea water can't remember) as the return path.
- amelius 2y agoHmm, fermions are still better for __power__ transport.
- jlokier 2y agoWhen you measure the flow of electrical power along a cable, the energy travels close to the speed of light, yet the electrons drift very, very slowly in comparison. Electrical power is transported as a fast-moving density wave in the electromagnetic force between many electrons and protons, the former drifting slowly. Not by the electrons themselves, as if energy were attached to them. The force responsible for transporting the energy so much faster than the electrons themselves move, is comprised of photons (bosons not fermions)...
- amelius 2y agoBy that analogy information flowing in a regular IC is also photons.
- amelius 2y ago> HITOP performs about 1 trillion operations per second, whereas sophisticated Nvidia chips can chug through 300 times as much data Wow, it sounds like optical computing is already closer than I expected.
- Q6T46nT668w6i3m 2y agoIf you have a laser, you can print an optical neural network using a consumer 3D printer. The present barrier to adoption, as the article describes, is the cost of transitioning from the optical space to the electronic space.
- omneity 2y agoDo you know where does this cost lie? Say for an organization with no prior spending on "legacy" electronics based hardware. Is it the sunken cost in existing hardware, or developing the rest of the "value chain" to make photonics work, or something else altogether?
- samus 2y agoYou have to miniaturize the components and be able to cram billions on a die of a few square centimeters at most. The industry has lots of experience doing that with electronics. Almost none with photonics. The silver lining is that one might need massively less photonic components to get the job done than electronic components due to the former's theoretically magnitudes higher switching frequency. And we might reserve them for graphics and AI at first.
- Rayhem 2y ago> If you have a laser, you can print an optical neural network using a consumer 3D printer. I would love to look into this more. Do you have a reference that would give some instructions on how to give this a go?
- CamperBob2 2y agoYou could think of a lens as a "Fourier transformer," not in the LLM sense directly but in the sense of something that executes a Fourier transform. See the excellent videos by Huygens Optics including this one: https://www.youtube.com/watch?v=Y9FZ4igNxNA https://www.youtube.com/watch?v=Y9FZ4igNxNA entitled "Fourier optics used for optical pattern recognition." Having established that, well, it's not hard to imagine that something that's good at running Fourier transforms is probably good for other situations where you need to run a lot of dot products in parallel. That, in turn, should sound like an awfully familiar problem...
- deleted 2y ago[deleted]
- synergy20 2y agoit's the photonics amplifiers that are very hard to make on wafer
- stuckinhell 2y agoCan't we just AI driven techniques to help optimize and reduce resource usage. I think we are all ready seeing good results. I'm super interested in the next gen chips as well. https://stability.ai/news/stability-ai-sdxl-turbo https://stability.ai/news/stability-ai-sdxl-turbo https://www.marktechpost.com/2023/01/05/deepminds-latest-ai-research-reduces-energy-usage-for-cooling-buildings/ https://www.marktechpost.com/2023/01/05/deepminds-latest-ai-...
- kevincox 2y agoWhy not both? Just because we can make our code more efficient doesn't mean we should go back to Motorola 6800s. We should make our code more efficient and make hardware that can run that code more efficently.
- noqc 2y agoRegular I doesn't need that much power, maybe we could just use that instead?
- ActionHank 2y agoOk, but how do you lie to VCs to trick them into thinking there is limitless potential in RI?
- hackable_sand 2y agoIt sounds like VC boards are semi-civilised bands of fairy tale creatures that have to be put to sleep with gold and fantastical tales or else you get kicked out the kingdom and they kidnap your children.
- j45 2y agoReminds me of lightera and infinera
- tempodox 2y agoApart from the fact that there is no such thing as AI (it's artificial all right but far from intelligence), this might be the next cryptocurrency, i.e. huge energy waste for no perceptible gain. Except this time there are way more suckers and a hype wave the likes of which we haven't seen since the web 1.0 bubble.
- DeathArrow 2y agoI agree there's no intelligence, and that there's hype, but on the other hand there's some useful stuff being solved by Machine Learning.
- DeathArrow 2y agoQuantum computing, carbon chips, biological chips, optical chips. I have heard about these supposed alternatives to classic silicon chips since at least 20 years ago. They always were 10 years from the point where they can show their super-powers. I am not saying it can't be done, but I think we are either limited by the level of science we know or by money. We are probably still far from a major breakthrough in computing that will yield exponential growth. And even when we will have the wonder chip, someone will port Javascript on it, so things can be slow again. :)
- parl_match 2y agoThe benefits have to outweigh the cost. We're finally reaching the edge of silicon based technologies, where improvements are not guaranteed or incremental. There's still, obviously, a lot of possible improvement, but it's finally worth seriously looking at alternatives. You'll likely start to see optical networking in cars first, fwiw.
- az09mugen 2y agoIn the first place, why use AI for such basic tasks as generate commit messages ?