2 ms·

Thanks for the summary This won't work alone for ML. The matrix sizes are huge with billions of parameters. Doing light based calculations for that seems impos

by imranq 3y ago

Thanks for the summary This won't work alone for ML. The matrix sizes are huge with billions of parameters. Doing light based calculations for that seems impossible with this technique. Potentially you could break apart a big matrix into smaller matrices for these chips to process

fnordpiglet 3y ago
“The potential for large scale” I think was the operative phrase. A PoC at 2x2, 10x10 etc demonstrates scaling characteristics and potential.
xscott 3y ago
A billion parameter matrix, if it was square, is 32,000 by 32,000. NVidia's tensor units are basically 4x4 matrix multipliers.