5 ms·

Maybe I’m dim today but I can’t tell if they mean via API or running locally in some manner. I guess if it’s local, it wouldn’t actually be the GPT we know. I’

Maybe I’m dim today but I can’t tell if they mean via API or running locally in some manner. I guess if it’s local, it wouldn’t actually be the GPT we know. I’ve been very excited about the idea that Apple takes a stab at having it run locally, because it would help improve what I consider to be by far the largest UX issue: the awkward latency.

dantyti 2y ago
For most of my use cases, the privacy impact of sending LLM queries to someone else is a larger UX issue
- dbish 2y ago
  For Apple, they know the average person doesn’t really care about this. They only lean into privacy when it’s a useful competitive weapon. There are many people willing to pay for products now that record their screen 24/7, or buy “AI” wearables that are just open mics. The Overton window shifted for privacy concerns somewhere between Google Glass (where people were barred from locations) and now. Still, it wouldn’t surprise me if they work with openai to release less powerful local models just for simple Siri use cases so they can keep using privacy for marketing.
  - amelius 2y ago
    > For Apple, they know the average person doesn’t really care about this. This is one sad thing about the free market: everybody is _not_ average in one way or the other, but all we get are products made for average people, so in the end everybody is a little bit unhappy. Some people are far from average, therefore they must be very unhappy. Now if only the products we bought weren't so much locked down, we could modify them and use them however we wanted to.
    - dbish 2y ago
      It would be nice if Apple products were less locked down. Android is the only option if you want that sadly for the phone space
stavros 2y ago
Latency is going to be far higher per response quality unit if you run the model on the phone.

5 ms·

Maybe I’m dim today but I can’t tell if they mean via API or running locally in some manner. I guess if it’s local, it wouldn’t actually be the GPT we know. I’

by Waterluvian 2y ago

dantyti 2y ago
For most of my use cases, the privacy impact of sending LLM queries to someone else is a larger UX issue
- dbish 2y ago
  For Apple, they know the average person doesn’t really care about this. They only lean into privacy when it’s a useful competitive weapon. There are many people willing to pay for products now that record their screen 24/7, or buy “AI” wearables that are just open mics. The Overton window shifted for privacy concerns somewhere between Google Glass (where people were barred from locations) and now. Still, it wouldn’t surprise me if they work with openai to release less powerful local models just for simple Siri use cases so they can keep using privacy for marketing.
  - amelius 2y ago
    > For Apple, they know the average person doesn’t really care about this. This is one sad thing about the free market: everybody is _not_ average in one way or the other, but all we get are products made for average people, so in the end everybody is a little bit unhappy. Some people are far from average, therefore they must be very unhappy. Now if only the products we bought weren't so much locked down, we could modify them and use them however we wanted to.
    - dbish 2y ago
      It would be nice if Apple products were less locked down. Android is the only option if you want that sadly for the phone space
stavros 2y ago
Latency is going to be far higher per response quality unit if you run the model on the phone.