3 ms·
The Nature Photonics article can be found here: https://www.nature.com/articles/s41566-024-01394-2 https://www.nature.com/articles/s41566-024-01394-2 This app
by curtisf 3y ago
The Nature Photonics article can be found here:
https://www.nature.com/articles/s41566-024-01394-2 https://www.nature.com/articles/s41566-024-01394-2
This appears to be the same paper published on arxiv:
https://arxiv.org/abs/2302.00793 https://arxiv.org/abs/2302.00793
The abstract describes the actual problem that these photonic chips solve:
> We designed and experimentally demonstrated a vector–matrix product for a 2 × 2 matrix and a 3 × 3 matrix. We also designed a 10 × 10 matrix using the proposed 2D computational method. These examples demonstrate that these techniques have the potential to enable larger-scale wave-based analogue computing platforms.
It appears the main contribution of this paper is not so much a new chip technology, but a new way to efficiently model the flow of light through a particular kind of chip (using raised and lowered bumps of silicon) that makes designing photonic chips that compute matrix multiplications practical.
For a fixed matrix, they can design a chip that approximately multiplies that matrix by an input query vector, using light.
Being a fixed matrix severely limits the usefulness of this for now, especially at the 2x2 and 3x3 sizes, but it could be useful if it could be made much larger, or ways to vary the contents of the matrix are discovered.
- imranq 3y agoThanks for the summary This won't work alone for ML. The matrix sizes are huge with billions of parameters. Doing light based calculations for that seems impossible with this technique. Potentially you could break apart a big matrix into smaller matrices for these chips to process
- fnordpiglet 3y ago“The potential for large scale” I think was the operative phrase. A PoC at 2x2, 10x10 etc demonstrates scaling characteristics and potential.
- xscott 3y agoA billion parameter matrix, if it was square, is 32,000 by 32,000. NVidia's tensor units are basically 4x4 matrix multipliers.