8 ms·

Sadly, I don't think so. Android already has NNAPI, but this post doesn't mention NNAPI at all. This seems focused on running on servers, instead of running on

• sorenjan 4y ago
  That would be a shame. Where does Apple fit in then, are they running custom ML frameworks in their cloud?
• scotttodd 4y ago
  The post itself doesn't get into too many details about edge deployment, but we're building the core technology to scale down to embedded systems without compromising on feature support. In fact, resource constrained devices really benefit from ahead-of-time compilation to improve binary size and finely control memory usage. We (IREE) published a paper focusing on such embedded device uses: https://arxiv.org/abs/2205.14479 https://arxiv.org/abs/2205.14479.