3 ms·

Single-chip photonic deep neural network with forward-only training

4 points by RansomStark 2y ago

RansomStark 2y ago
Arxiv link: https://arxiv.org/abs/2208.01623 https://arxiv.org/abs/2208.01623
westurner 2y ago
"Single-chip photonic deep neural network with forward-only training" (2024) https://www.nature.com/articles/s41566-024-01567-z https://www.nature.com/articles/s41566-024-01567-z : > Here we realize such a system in a scalable photonic integrated circuit that monolithically integrates multiple coherent optical processor units for matrix algebra and nonlinear activation functions into a single chip. We experimentally demonstrate this fully integrated coherent optical neural network architecture for a deep neural network with six neurons and three layers that optically computes both linear and nonlinear functions [...] > This work lends experimental evidence to theoretical proposals for in situ training, enabling orders of magnitude improvements in the throughput of training data. Moreover, the fully integrated coherent optical neural network opens the path to inference at nanosecond latency and femtojoule per operation energy efficiency.
- westurner 2y ago
  > femtojoule per operation energy efficiency From "Transistor for fuzzy logic hardware: promise for better edge computing" https://news.ycombinator.com/item?id=42166303 https://news.ycombinator.com/item?id=42166303 : > From "A carbon-nanotube-based tensor processing unit" (2024) https://www.nature.com/articles/s41928-024-01211-2 https://www.nature.com/articles/s41928-024-01211-2 : >> Using system-level simulations, we estimate that an 8 bit TPU made with nanotube transistors at a 180 nm technology node could reach a main frequency of 850 MHz and an energy efficiency of 1 tera-operations per second per watt. Performance per watt: https://en.wikipedia.org/wiki/Performance_per_watt https://en.wikipedia.org/wiki/Performance_per_watt
  - westurner 2y ago
    https://news.ycombinator.com/item?id=41702789#41706409 https://news.ycombinator.com/item?id=41702789#41706409 : > 5nm process
    - westurner 2y ago
      "Ask HN: Can qubits be written to crystals as diffraction patterns?" https://news.ycombinator.com/item?id=38501668 https://news.ycombinator.com/item?id=38501668 Notes from "Single atom defect in 2D material can hold quantum information at room temp" (2024) https://news.ycombinator.com/item?id=40478219 https://news.ycombinator.com/item?id=40478219 re Qubit data storage (quantum wave transmission through spacetime) "Reversible optical data storage below the diffraction limit" (2024) https://news.ycombinator.com/item?id=38528877 https://news.ycombinator.com/item?id=38528877 : > multiplexing Diamond with different color beams , "Real-space nanophotonic field manipulation using non-perturbative light–matter coupling" (2023) ; below the Abbe diffraction limit optional tweezers at 1/50 the photonic wavelength "DNA-folding nanorobots can manufacture limitless copies of themselves" https://news.ycombinator.com/item?id=38569474 https://news.ycombinator.com/item?id=38569474 Phase from Intensity because Huygens' classical oscillatory model applies to photons; From "Physicists use a 350-year-old theorem to reveal new properties of light waves" https://news.ycombinator.com/item?id=37226160 https://news.ycombinator.com/item?id=37226160 : >> [..] Qian's team interpreted the intensity of a light as the equivalent of a physical object's mass, then mapped those measurements onto a coordinate system that could be interpreted using Huygens' mechanical theorem. "Essentially, we found a way to translate an optical system so we could visualize it as a mechanical system, then describe it using well-established physical equations," explained Qian. >> Once the team visualized a light wave as part of a mechanical system, new connections between the wave's properties immediately became apparent—including the fact that entanglement and polarization stood in a clear relationship with "Bridging coherence optics and classical mechanics: A generic light polarization-entanglement complementary relation" (2023) https://journals.aps.org/prresearch/abstract/10.1103/PhysRevResearch.5.033110 https://journals.aps.org/prresearch/abstract/10.1103/PhysRev... : > Abstract: [...] Here we report links of the two through a systematic quantitative analysis of polarization and entanglement, two optical coherence properties under the wave description of light pioneered by Huygens and Fresnel. A generic complementary identity relation is obtained for arbitrary light fields. More surprisingly, through the barycentric coordinate system, optical polarization, entanglement, and their identity relation are shown to be quantitatively associated with the mechanical concepts of center of mass and moment of inertia via the Huygens-Steiner theorem for rigid body rotation. The obtained result bridges coherence wave optics and classical mechanics through the two theories of Huygens. /?hnlog coherent , single photon [...] "Photonic quantum Hall effect and multiplexed light sources of large orbital angular momenta (2021) https://www.nature.com/articles/s41567-021-01165-8 https://www.nature.com/articles/s41567-021-01165-8 .. https://engineering.berkeley.edu/news/2021/02/light-unbound-optical-topological-antennas/ https://engineering.berkeley.edu/news/2021/02/light-unbound-... : "Coherent interaction of a-few-electron quantum dot with a terahertz optical resonator" (2023) https://arxiv.org/abs/2204.10522 https://arxiv.org/abs/2204.10522 .. https://news.ycombinator.com/item?id=39365579 https://news.ycombinator.com/item?id=39365579 From https://news.ycombinator.com/item?id=39287722 https://news.ycombinator.com/item?id=39287722 : > "Room-temperature quantum coherence of entangled multiexcitons in a metal-organic framework" (2024) https://www.science.org/doi/10.1126/sciadv.adi3147 https://www.science.org/doi/10.1126/sciadv.adi3147 > "A physical [photonic] qubit with built-in error correction" (2024) https://news.ycombinator.com/item?id=39243929 https://news.ycombinator.com/item?id=39243929 > What about phononic quantum computing though, are phononic wave functions stable/coherent?

4 points by RansomStark 2y ago

Arxiv link: https://arxiv.org/abs/2208.01623 https://arxiv.org/abs/2208.01623

"Single-chip photonic deep neural network with forward-only training" (2024) https://www.nature.com/articles/s41566-024-01567-z https://www.nature.com/articles/s41566-024-01567-z : > Here we realize such a system in a scalable photonic integrated circuit that monolithically integrates multiple coherent optical processor units for matrix algebra and nonlinear activation functions into a single chip. We experimentally demonstrate this fully integrated coherent optical neural network architecture for a deep neural network with six neurons and three layers that optically computes both linear and nonlinear functions [...] > This work lends experimental evidence to theoretical proposals for in situ training, enabling orders of magnitude improvements in the throughput of training data. Moreover, the fully integrated coherent optical neural network opens the path to inference at nanosecond latency and femtojoule per operation energy efficiency.

westurner 2y ago
> femtojoule per operation energy efficiency From "Transistor for fuzzy logic hardware: promise for better edge computing" https://news.ycombinator.com/item?id=42166303 https://news.ycombinator.com/item?id=42166303 : > From "A carbon-nanotube-based tensor processing unit" (2024) https://www.nature.com/articles/s41928-024-01211-2 https://www.nature.com/articles/s41928-024-01211-2 : >> Using system-level simulations, we estimate that an 8 bit TPU made with nanotube transistors at a 180 nm technology node could reach a main frequency of 850 MHz and an energy efficiency of 1 tera-operations per second per watt. Performance per watt: https://en.wikipedia.org/wiki/Performance_per_watt https://en.wikipedia.org/wiki/Performance_per_watt
- westurner 2y ago
  https://news.ycombinator.com/item?id=41702789#41706409 https://news.ycombinator.com/item?id=41702789#41706409 : > 5nm process
  - westurner 2y ago
    "Ask HN: Can qubits be written to crystals as diffraction patterns?" https://news.ycombinator.com/item?id=38501668 https://news.ycombinator.com/item?id=38501668 Notes from "Single atom defect in 2D material can hold quantum information at room temp" (2024) https://news.ycombinator.com/item?id=40478219 https://news.ycombinator.com/item?id=40478219 re Qubit data storage (quantum wave transmission through spacetime) "Reversible optical data storage below the diffraction limit" (2024) https://news.ycombinator.com/item?id=38528877 https://news.ycombinator.com/item?id=38528877 : > multiplexing Diamond with different color beams , "Real-space nanophotonic field manipulation using non-perturbative light–matter coupling" (2023) ; below the Abbe diffraction limit optional tweezers at 1/50 the photonic wavelength "DNA-folding nanorobots can manufacture limitless copies of themselves" https://news.ycombinator.com/item?id=38569474 https://news.ycombinator.com/item?id=38569474 Phase from Intensity because Huygens' classical oscillatory model applies to photons; From "Physicists use a 350-year-old theorem to reveal new properties of light waves" https://news.ycombinator.com/item?id=37226160 https://news.ycombinator.com/item?id=37226160 : >> [..] Qian's team interpreted the intensity of a light as the equivalent of a physical object's mass, then mapped those measurements onto a coordinate system that could be interpreted using Huygens' mechanical theorem. "Essentially, we found a way to translate an optical system so we could visualize it as a mechanical system, then describe it using well-established physical equations," explained Qian. >> Once the team visualized a light wave as part of a mechanical system, new connections between the wave's properties immediately became apparent—including the fact that entanglement and polarization stood in a clear relationship with "Bridging coherence optics and classical mechanics: A generic light polarization-entanglement complementary relation" (2023) https://journals.aps.org/prresearch/abstract/10.1103/PhysRevResearch.5.033110 https://journals.aps.org/prresearch/abstract/10.1103/PhysRev... : > Abstract: [...] Here we report links of the two through a systematic quantitative analysis of polarization and entanglement, two optical coherence properties under the wave description of light pioneered by Huygens and Fresnel. A generic complementary identity relation is obtained for arbitrary light fields. More surprisingly, through the barycentric coordinate system, optical polarization, entanglement, and their identity relation are shown to be quantitatively associated with the mechanical concepts of center of mass and moment of inertia via the Huygens-Steiner theorem for rigid body rotation. The obtained result bridges coherence wave optics and classical mechanics through the two theories of Huygens. /?hnlog coherent , single photon [...] "Photonic quantum Hall effect and multiplexed light sources of large orbital angular momenta (2021) https://www.nature.com/articles/s41567-021-01165-8 https://www.nature.com/articles/s41567-021-01165-8 .. https://engineering.berkeley.edu/news/2021/02/light-unbound-optical-topological-antennas/ https://engineering.berkeley.edu/news/2021/02/light-unbound-... : "Coherent interaction of a-few-electron quantum dot with a terahertz optical resonator" (2023) https://arxiv.org/abs/2204.10522 https://arxiv.org/abs/2204.10522 .. https://news.ycombinator.com/item?id=39365579 https://news.ycombinator.com/item?id=39365579 From https://news.ycombinator.com/item?id=39287722 https://news.ycombinator.com/item?id=39287722 : > "Room-temperature quantum coherence of entangled multiexcitons in a metal-organic framework" (2024) https://www.science.org/doi/10.1126/sciadv.adi3147 https://www.science.org/doi/10.1126/sciadv.adi3147 > "A physical [photonic] qubit with built-in error correction" (2024) https://news.ycombinator.com/item?id=39243929 https://news.ycombinator.com/item?id=39243929 > What about phononic quantum computing though, are phononic wave functions stable/coherent?