4 ms·I think this is largely unnecessary, can't things like TPUs handle the inference?by foota 7y agoI think this is largely unnecessary, can't things like TPUs handle the inference?struxure 7y agoUsing TPUs is expensive. Also some applications may need small latencythe8472 7y agoPutting all your speech/text onto cloud machines runs counter to e2e encrypted messaging.foota 7y agoI think you can get hardware like a TPU for consumer products?