2 ms·
So this is purely for inference right? Basically you're setting up a physical analog inference device by writing weights to flash memory and then using the devi
by nharada 5y ago
So this is purely for inference right? Basically you're setting up a physical analog inference device by writing weights to flash memory and then using the device properties to do that mat-muls required for the forward pass?
This is super cool, I'd really like to see how this shakes out in actual products in terms of models supported, actual costs and performance, etc.