4 ms·
Oh yes, I could definitely see the privacy-preserving consumer use case creating sufficient demand for efficiency that also bleeds over into the enterprise mark
by lxgr 2y ago
Oh yes, I could definitely see the privacy-preserving consumer use case creating sufficient demand for efficiency that also bleeds over into the enterprise market.
That's what's happened with power efficiency and ARM CPUs, after all!
- adunsulag 2y agoThis is where I want highly sensitive healthcare consumers of LLMs to be at. Note summation, suggested diagnosis (provider always in control), and other augmented abilities for the clinical staff without the risk of health care data sent outside the device, or the very local network.
- adam_arthur 2y agoNot sure what you mean: https://aws.amazon.com/ec2/graviton/ https://aws.amazon.com/ec2/graviton/ Not to speak of managed cloud services that run on ARM under-the-hood/behind the scenes. Of course ARM isn't inherently cheaper, AMD+Intel could cut prices/margins big and probably be competitive on $/perf
- lxgr 2y agoThat's what I mean: ARM was initially attractive in the low-power/low-performance market, then it scaled up to higher and higher power cores (while still staying power efficient), which in turn attracted datacenter customers.