3 ms·

Apple is in the position where it caters primarily to the tech ignorant, so coming out an explaining that Apple LLM is a bit worse (read: far worse) than the co

Apple is in the position where it caters primarily to the tech ignorant, so coming out an explaining that Apple LLM is a bit worse (read: far worse) than the cool LLM's on the internet because they are privacy conscious is a non-starter. Local LLM's on regular local hardware (i.e. no $500+ dedicated GPUs) is way far behind SoTA models right now. Apple is not gonna be in a position where you can practically real-time intelligently chat with Android phones while iPhones are churning out 3 tokens/second of near useless babbling.

philsnow 2y ago
(I haven’t watched the video yet) I completely agree about the market positioning and not keeping up with other platforms’ abilities being a non-starter. I just hope it will be clear how to keep my external brain (phone) from being scanned by OpenAI. (I don’t want it to seem like I’m just a hater of either Apple or OpenAI; I’m a more-recent adopter of Apple tech and I’m not looking back, and I have an OpenAI subscription and find it invaluable for some uses.) Another thing I’m going to be looking for in the video is how this initiative jibes with the greenness Apple has been passing really hard. If they’re bringing this kind of generative AI from niches to every iphone, it seems that would add a fair amount of power consumption.
- noahtallen 2y ago
  > I just hope it will be clear how to keep my external brain (phone) from being scanned by OpenAI. It's very clear, the keynote demonstrates that Siri passing a prompt to chatGPT is completely opt-in and only happens when Siri thinks the prompt needs the more generative/creative model that OpenAI provides.