6 ms·

Apple comes to mind.

• BryantD 4y ago
  Agreed. Apple will run models remotely if necessary, but from a PR perspective they align with their stated intentions when they can run locally.
  • mustacheemperor 4y ago
    Oh, how I hope there is a project ongoing at Apple right now to implement some kind of on-device LLM that can drive the phone a la Siri. Any time I open the Bing app on my iPhone to answer a question I think of how useful it could be to ask it to update my calendar, fill out a dinner order, etc. How much time do we collectively waste putzing around with delivery apps etc?
    • smoldesu 4y ago
      It would be neat, but iPhone hardware has limited memory (and iOS limits that usage further). It would be much faster and higher-quality to run it as an API request like it is today.
      • yieldcrv 4y ago
        Given the incentive, it can push the hardware in this direction. Or they’ll do a home network device like implement it like a HomeKit hub. So the plugged in resource has more computational power and feeds it to iphones when nearby. Disconnected, the iphone uses a much more rudimentary one or falls back to Siri or a cloud service.
        • gpderetta 4y ago
          Your phone can remotely connect to your home device when needed.
        • smoldesu 4y ago
          Maybe it will use lasers to paint a smiley face on my wall! Only two things are for certain; you'll have to pay for it, and it will not be cheap.
    • gpderetta 4y ago
      Apple Siri as a device you can run on your home as a digital assistant.