4 ms·

> when these neural engines kick in in open source software? It mostly doesn't because NPUs are bespoke and vendor-specific (which incents neglect by software

> when these neural engines kick in in open source software? It mostly doesn't because NPUs are bespoke and vendor-specific (which incents neglect by software devs working on open source numerics and ML/AI infrastructure), and the Apple ANE is no exception. Part of this effort is most likely about fixing that for the specific case of the Apple ANE.

blobbers 8mo ago
Part of which effort? The Reverse engineering is so it can be used blog article? I just think: great it seems like I'm paying for a hardware accelerator that makes Siri go faster. And I use siri on my laptop exactly 0 times in the last infinite years.
- bri3d 8mo ago
  It also makes a lot of really useful features like on device OCR, captions, voice isolation, temporal antialiasing in metalfx, an enormous host of things in the apple pro apps, etc. work
  - blobbers 8mo ago
    Yeah, I don't use any of those features. So it sounds like its for folks who are creatives running lightroom or apple movie, or some kind of apple sound program? I'm a dev, not a creative, unfortunately. I don't use other people's software, I generally write my own (or used to before Claude took over my world).
    - saagarjha 8mo ago
      You bought a truck. Obviously there will be some part of it you don’t use.
      - blobbers 8mo ago
        I think its more like it advertises it can climb hills in crawl mode, but turns out its only specific hills. So fundamentally, it still comes down to CPUs + RAM.