3 ms·
>Huh... why is he comparing it to network (cloud) transfers and not to the current CPU-RAM transfers? I thought the benefit of compute-in-memory is reduction of
by senttoschool 4y ago
>Huh... why is he comparing it to network (cloud) transfers and not to the current CPU-RAM transfers? I thought the benefit of compute-in-memory is reduction of CPU-RAM transfers and that's what they're also saying in the beginning of the article.
He's saying that they can now perform heavier calculations on the edge device using their novel chip design. Currently, these calculations have to be sent to the cloud to perform because chips today can't compute them without wasting too much battery.
For example, Siri has recently implemented on-device AI processing for many queries because the neural engine inside Apple SoCs have gotten so much more powerful and efficient. Previously, all Siri requests were sent to the cloud.[0]
[0]https://www.theguardian.com/technology/2021/jun/07/apple-overhauls-siri-to-address-privacy-concerns-and-improve-performance https://www.theguardian.com/technology/2021/jun/07/apple-ove...