20 ms·
> In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coheren
by andsoitis 3y ago
> In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending data up to the cloud for processing).
Their primary business goal is to sell hardware. Yes, they’ve diversified into services and being a shopping mall for all, but it is about selling luxury hardware.
The promise of privacy is one way in which they position themselves, but I would not bet the bank on that being true forever.
- ActorNightly 3y ago>The promise of privacy is one way in which they position themselves, but I would not bet the bank on that being true forever. Everyone seems to have forgotten about the Celebrity iCloud photo leak.
- serial_dev 3y agoIt doesn't need to stay true forever. The alternative is Google / Android devices and OpenAI wrapper apps, both of which usually offer a half baked UI, poor privacy practices, and a completely broken UX when the internet connection isn't perfect. Pair this with the completely subpar Android apps, Google dropping support for an app about once a month, and suddenly I'm okay with the lesser of two evils. I know they aren't running a charity, I even hypothesized that Apple just can't build good services so they pivoted to focusing on this fake "privacy" angle. In the end, iPhones are likely going to be better for edge AI than whatever is out there, so I'm looking forward to this.
- jocaal 3y ago> better for edge AI than whatever is out there, so I'm looking forward to this What exactly are you expecting? The current hype for AI is large language models. The word 'large' has a certain meaning in that context. Much larger that can fit on your phone. Everyone is going crazy about edge AI, what am I missing?
- jchanimal 3y agoIt fits on your phone, and your phone can offload battery burning tasks to nearby edge servers. Seems like the path consumer-facing AI will take.
- deleted 3y ago[deleted]
- jitl 3y agoQuantized LLMs can run on a phone, like Gemini Nano or OpenLLAMA 3B. If a small local model can handle simple stuff and delegate to a model in the data center for harder tasks and with better connectivity you could get an even better experience.
- SmellTheGlove 3y ago> If a small local model can handle simple stuff and delegate to a model in the data center for harder tasks and with better connectivity you could get an even better experience. Distributed mixture of experts sounds like an idea. Is anyone doing that?
- cheschire 3y agoSounds like an attack vector waiting to happen if you deploy enough competing expert devices into a crowd. I’m imagining a lot of these LLM products on phones will be used for live translation. Imagine a large crowd event of folks utilizing live AI translation services being told completely false translations because an actor deployed a 51% attack.
- jagger27 3y agoI’m not particularly scared of a 51% attack between the devices attached to my Apple ID. If my iPhone splits inference work with my idle MacBook, Apple TV, and iPad, what’s the problem there?
- 3y ago
- kernal 3y ago>subpar Android apps Care to cite these subpar Android apps? The app store is filled to the brim with subpar and garbage apps. >Google dropping support for an app about once a month I mean if you're going to lie why not go bigger >I'm okay with the lesser of two evils. So the more evil company is the one that pulled out of China because they refused to hand over their users data to the Chinese government on a fiber optic silver plate?
- martimarkov 3y agoGoogle operates in China albeit via their HK domain. They also had project DragonFly if you remember. The lesser of two evils is that one company doesn’t try to actively profile me (in order for their ads business to be better) with every piece of data it can find and forces me to share all possible data with them. Google is famously known to kill apps that are good and used by customers: https://killedbygoogle.com/ https://killedbygoogle.com/ As for the subpar apps: there is a massive difference between the network traffic when on the Home Screen between iOS and Android.
- kernal 3y ago>Google operates in China albeit via their HK domain. The Chinese government has access to the iCloud account of every Chinese Apple user. >They also had project DragonFly if you remember. Which never materialized. >The lesser of two evils is that one company doesn’t try to actively profile me (in order for their ads business to be better) with every piece of data it can find and forces me to share all possible data with them. Apple does targeted and non targeted advertising as well. Additionally, your carrier has likely sold all of the data they have on you. Apple was also sued for selling user data to ad networks. Odd for a Privacy First company to engage in things like that. >Google is famously known to kill apps that are good and used by customers: https://killedbygoogle.com/ https://killedbygoogle.com/ Google has been around for 26 years I believe. According to that link 60 apps were killed in that timeframe. According to your statement that Google kills an app a month that would leave you 252 apps short. Furthermore, the numbers would indicate that Google has killed 2.3 apps per year or .192 apps per month. >As for the subpar apps: there is a massive difference between the network traffic when on the Home Screen between iOS and Android. Not sure how that has anything to do with app quality, but if network traffic is your concern there's probably a lot more an Android user can do than an iOS user to control or eliminate the traffic.
- rfoo 3y ago> The alternative is Google / Android devices No, the alternative is Android devices with everything except firmware built from source and signed by myself. And at the same time, being secure, too. You just can't have this on Apple devices. On Android side choices are limited too, I don't like Google and especially their disastrous hardware design, but their Pixel line is the most approachable one able to do all these. Heck, you can't even build your own app for your own iPhone without buying another hardware (a Mac, this is not a software issue, this is a legal issue, iOS SDK is licensed to you on the condition of using on Apple hardware only) and a yearly subscription. How is this acceptable at all?
- adamomada 3y agoThe yearly subscription is for publishing your app on Apple’s store and definitely helps keep some garbage out. Running your own app on your own device is basically solved with free third party solutions now (see AltStore and since a newer method I can’t recall atm)
- tsimionescu 3y agoThose are only available in the EU, and Apple has been huffing and puffing even here.
- dns_snek 3y agoNotice that parent never talked about publishing apps, just building and running apps on their own device. "Publishing on AltStore" (or permanently running the app on your own device in any other way) still requires a $100/year subscription as far as I'm aware.
- simfree 3y agoWebGPU and many other features on iOS are unimplemented or implemented in half-assed or downright broken ways. These features work on all the modern desktop browsers and on Android tho!
- Aloisius 3y ago
- cbsmith 3y agoGoogle has also been working on (and provides kits for) local machine learning on mobile devices... and they run on both iOS and Android. The Gemini App does send data in to Google for learning, but even that you can opt out of. Apple's definitely pulling a "Heinz" move with privacy, and it is true that they're doing a better job of it overall, but Google's not completely horrible either.
- Wytwwww 3y agoYou won't be able to run any model even as remotely as capable as Gemini locally though.
- cbsmith 3y agoIt's kind of tautological that Gemini Nano is as capable as Gemini and it runs locally. https://store.google.com/intl/en/ideas/articles/pixel-feature-drop-december-2023/ https://store.google.com/intl/en/ideas/articles/pixel-featur...
- Wytwwww 3y agoYeah, I was thinking of their non-local model like Gemini advanced though. In any case iPhone probably don't have enough memory to run a 3.25B model? e.g. 15 pro only have 8 GB (and Gemini Nano seems to only work on the 12GB Pixel 8 Pro) and 14 has only 6GB, that hardly seems sufficient for even a small LLM if you still you want to run the full OS and other apps at the same time.
- bamboozled 3y agoAs soon as the privacy thing goes away, I'd say a major part of their customer base goes away too. Most people use android so they don't get "hacked" if Apple is doing the hacking, I'd just buy a cheaper alternative.
- Draiken 3y agoAt least here in Brazil, I've never heard such arguments. Seems even more unlikely for non technical users. It's just their latest market campaign, as far as I can tell. The vast majority of people buy iPhones because of the status it gives.
- everly 3y agoThey famously had a standoff with the US gov't over the Secure Enclave. Marketing aside, all indications point to the iOS platform being the most secure mobile option (imo).
- elzbardico 3y agoThis is a prejudiced take. Running AI tasks locally on the device definitely is a giant improvement for the user experience. But not only that, Apple CPUs are objectively leagues ahead of their competition in the mobile space. I am still using a IPhone released in 2020 with absolutely no appreciable slow down or losses in perceived performance. Because even a 4 years old IPhone still has specs that don't lag behind by much the equivalent Android phones, I still receive the latest OS updates, and because frankly, Android OS is mess. If I cared about status, I would have changed my phone already for a new one.
- kernal 3y ago>Apple CPUs are objectively leagues ahead of their competition in the mobile space This is a lie. The latest Android SoCs are just as powerful as the A series. >Because even a 4 years old IPhone still has specs that don't lag behind by much the equivalent Android phones, I still receive the latest OS updates, and because frankly, Android OS is mess. Samsung and Google offer 7 years of OS and security updates. I believe that beats the Apple policy.
- nox101 3y agoTheir primary business is transitioning to selling services and extracting fees. It's their primary growth
- brookst 3y agoHey, I'm way ahead of Apple. I sell my services to my employer and extract fees from them. Do you extract fees too?
- nox101 3y agoI'm not sure what you're point is. My point (which I failed at), is that Apple's incentives are changing because their growth is dependent on services and extracting fees so they will likely do things that try to make people dependent on those services and find more ways to charge fees (to users and developers). Providing services is arguably at odds with privacy since a service with access to all the data can provide a better service than one without so there will be a tension between trying to provide the best services, fueling their growth, and privacy.
- brookst 3y agoI apologize for being oblique and kind of snarky. My point was that it's interesting how we can frame a service business "extracting fees" to imply wrongdoing. When it's pretty normal for all services to charge ongoing fees for ongoing delivery.
- ClumsyPilot 3y agoIt’s about the money, it’s about perverse incentives and propensity of service businesses to get away with unfair practices. We have decent laws about your rights as a consumer when you buy stuff, but like no regulation of services
- brookst 3y agoThere is tons of regulation of services? Everything from fraud / false advertising to disclosure of fees to length and terms of contracts. What regulation do you think is missing? And as someone who presumably provides services for a living, what additional regulations would you like to be subject to?
- stouset 3y agoNothing is true forever. Google wasn’t evil forever, Apple won’t value privacy forever. Until we figure out how to have guarantees of forever, the best we can realistically do is evaluate companies and their products by their behavior now weighted by their behavior in the past.
- veunes 3y agoPrivacy is challenging to achieve
- klabb3 3y ago> but it is about selling luxury hardware. Somewhat true but things are changing. While there are plenty of “luxury” Apple devices like Vision Pro or fully decked out MacBooks for web browsing we no longer live in a world where tech are just lifestyle gadgets. People spend hours a day on their phones, and often run their life and businesses through it. Even with the $1000+/2-3y price tag, it’s simply not that much given how central role it serves in your life. This is especially true for younger generations who often don't have laptops or desktops at home, and also increasingly in poorer-but-not-poor countries (say eg Eastern Europe). So the iPhone (their best selling product) is far, far, far more a commodity utility than typical luxury consumption like watches, purses, sports cars etc. Even in the higher end products like the MacBooks you see a lot of professionals (engineers included) who choose it because of its price-performance-value, and who don’t give a shit about luxury. Especially since the M1 launched, where performance and battery life took a giant leap.
- _the_inflator 3y agoI disagree. Apple is selling hardware and scaling AI by utilizing it is simply a smart move. Instead of building huge GPU clusters, having to deal with NVIDIA for GOUs (Apple kicked NVIDIA out years ago because of disagreements), Apple is building mainly on existing hardware. This is in other terms utilizing CPU power. On the other hand this helps their marketing keeping high price points when Apple now is going to differentiate their COU power and therefore hardware prices over AI functionality correlating with CPU power. This is also consistent with Apple stopping the MHz comparisons years ago.
- klabb3 3y agoDid you reply to the right comment? Feels like we’re talking about different things altogether.
- bingbingbing777 3y agoWhat AI is Apple scaling?
- 3y ago
- hehdhdjehehegwv 3y agoAs a privacy professional for many, many years this is 100% correct. Apple wouldn’t be taking billions from Google for driving users to their ad tracking system, they wouldn’t give the CCP access to all Chinese user data (and maybe beyond), and they wouldn’t be on-again-off-again flirting with tailored ads in Apple News if privacy was a “human right”. (FWIW my opinion is it is a human right, I just think Tim Cook is full of shit.) What Apple calls privacy more often than not is just putting lipstick on the pig that is their anticompetitive walled garden. Pretty much everybody in SV who works in privacy rolls their eyes at Apple. They talk a big game but they are as full of shit as Meta and Google - and there’s receipts to prove it thanks to this DoJ case. Apple want to sell high end hardware. On-device computation is a better user experience, hands down. That said, Siri is utter dogshit so on-device dogshit is just faster dogshit.
- moneywoes 3y agoany private guides for todays smartphone user?
- hehdhdjehehegwv 3y agoAt this point call your government representatives and ask for new laws, or if you live someplace with laws, actual enforcement (looking at you EU). The idea that user behavior or consumer choice will change any of this is basically discredited in practice. It will always been cat and mouse until the point that CEOs go to jail, then it will stop.
- lynx23 3y agoCEOs dont go to jail. If they do, its an exception that is not relevant to the game.
- hehdhdjehehegwv 3y ago[flagged]
- kortilla 3y agoThe MacBook Air is not a luxury device. That meme is out of date
- pseufaux 3y agoCurious what criteria you're using for using for qualifying luxury. It seems to me that materials, software, and design are all on par with other more expansive Apple products. The main difference is the chipset which I would argue is on an equal quality level as the pro chips but designed for a less power hungry audience.
- ozim 3y agoMaybe for you, but I still see sales guys who refuse working on WinTel where basically what the do is browse internet and do spreadsheets - so mainly just because they would not look cool compared to other sales guys rocking MacBooks.
- stevage 3y agoI don't buy this "looking cool" argument. I have used both. I think the Mac experience is significantly better. No one is looking at me.
- ozim 3y agoI provide laptops to people from time to time. They expect to get a MacBook even if company is Windows and they don’t have any real arguments.
- lolinder 3y agoI can't buy a MacBook Air for less than $999, and that's for a model with 8GB RAM, an 8-core CPU and 256GB SSD. The equivalent (based on raw specs) in the PC world runs for $300 to $500. How is something that is twice as expensive as the competition not a luxury device? EDIT: Because there's repeated confusion in the replies: I am not saying that a MacBook Air is not objectively a better device. I'm saying it is better by metrics that fall strictly into the "luxury" category. Better build quality, system-on-a-chip, better OS, better battery life, aluminum case—all of these are luxury characteristics that someone who is looking for a functional device that meets their needs at a decent price won't have as dealbreakers.
- moritzwarhier 3y ago> > In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending data up to the cloud for processing). > Their primary business goal is to sell hardware. There is no contradiction here. No need for luxury. Efficient hardware scales, Moore's law has just been rewritten, not defeated. Power efficiency combined with shared and extremely fast RAM, it is still a formula for success as long as they are able to deliver. By the way, M-series MacBooks have crossed bargain territory by now compared to WinTel in some specific (but large) niches, e.g. the M2 Air. They are still technically superior in power efficiency and still competitive in performance in many common uses, be it traditional media decoding and processing, GPU-heavy tasks (including AI), single-core performance... By the way, this includes web technologies / JS.
- ewhanley 3y agoThis is it. An M series air is an incredible machine for most people - people who likely won’t ever write a line of js or use a GPU. Email, banking, YouTube, etc ona device with incredible battery and hardware that will likely be useful for a decade is perfect. The average user hasn’t even heard of HN.
- xvector 3y agoIt's great for power users too. Most developers really enjoy the experience of writing code on Macs. You get a Unix based OS that's just far more usable and polished than a Linux laptop. If you're into AI, there's objectively literally no other laptop on the planet that is competitive with the GPU memory available on an MBP.
- wiseowise 3y agoIt's an amazing machine for engineers too.
- LettuceSand12 3y agoAre newer airs good enough for development?
- jimbokun 3y agoFor all their competitors it’s not true right now.
- VelesDude 3y agoI think it was Paul Thurrott on Windows Weekly podcast who said that all these companies don't really care about privacy. Apple takes billions of dollar a year to direct data towards Google via the search defaults. Clearly privacy has a price. And I suspect it will only get worse with time as they keep chasing the next quarter. Tim Cook unfortunately is so captured in that quarterly mindset of 'please the share holders' that it is only a matter of time.
- spacebanana7 3y agoApple isn't ethically Mullvad, but they're much better than some of their android competitors who allow adverts on the lock screen.
- cvwright 3y agoIt doesn’t matter to me if they “really care” about privacy or not. Megacorps don’t “really care” about anything except money. What matters to me is that they continue to see privacy as something they can sell in order to make money.
- VelesDude 3y agoYeah, some poor phrasing on my behalf. I do hope that those working in these companies actually building the tools do care. But unfortunately, it seems that corruption is an emergent property of complexity.
- Cthulhu_ 3y agoThe Google payments are an interesting one; I don't think it's a simple "Google pays them to prefer them", but a "Google pays them to stop them from building a competitor". Apple is in the position to build a competing search product, but the amount Google pays is the amount of money they would have to earn from it, and that is improbable even if it means they can set their own search engine as default.
- deleted 3y ago[deleted]
- raincole 3y agoPrivacy is a luxury today so yeah selling luxury hardware and promise of privacy form a coherent business position.
- ngcc_hk 3y agoIf you average out it is quite not expensive. Unlike android phone or let us not talk about android tablet. The important is that a good starting ai learning platform is what … most apple does not touch those price. Hence with privacy it is a good path. You do not want communism even if it is not expensive in the short term.
- sneak 3y agoIt’s not even true now. Apple (and by the extension USG and CCP) can read ~every iMessage. The e2ee is backdoored.
- pompino 3y ago>The promise of privacy is one way in which they position themselves, but I would not bet the bank on that being true forever. They failed with their ad-business so this is a nice pivot. I'll take it, I'm not usually a cheerleader for Apple, but I'll support anyone who can erode Google's surveillance dominance.
- m463 3y ago> The promise of privacy I have very little faith in apple in this respect. For clarity, just install little snitch on your machine, and watch what happens with your system. Even without being signed in with an apple id and everything turned off, apple phones home all the time.
- transpute 3y agoYou can block 17.0.0.0 at the router, opening up only the notification servers. CDNs are a bit harder, but can be done with dnsmasq allow/deny of wildcard domains. Apple has documentation on network traffic from their devices, https://support.apple.com/en-us/101555 https://support.apple.com/en-us/101555
- m463 3y agoyou can also use privoxy and use it in network settings
- lynx23 3y agoEvery company is selling one thing or another, and nothing is going to last forever. I really fail to see what, except for generic negativity, your comment adds to anything.
- jsxlite 3y agoI wouldn't bank on that being true forever after 2012. A corporation is goal are vastly determined by the corporate structure.
- Refusing23 3y agoTheir 2nd largest revenue source (at ... 20-25%, below only the iphone) is software services. iCloud, App store revenue, apple tv, and so on
- yunwal 3y agoWhy would all services be grouped together in a single category when all hardware is not? iCloud and Apple TV are very different.
- 8fingerlouie 3y ago> but it is about selling luxury hardware. While Apple is first and foremost a hardware company, it has more or less always been about the "Apple experience". They've never "just" been a hardware company. For as long as Apple has existed, they've done things "their way" both with hardware and software, though they tend to want to abstract the software away. If it was merely a question of selling hardware, why does iCloud exist ? or AppleTV+, or Handoff ? or iMessage, or the countless other seemingly small life improvements that somehow the remainder of the industry cannot seem to figure out how to do well. Just a "simple" thing as switching headphones seamlessly between devices is something i no longer think about, it just happens, and it takes a trip with a Windows computer and a regular bluetooth headset to remind me how things used to be. As part of their "privacy first" strategy, iMessage also fits in nicely. Apple doesn't have to operate a huge instant messaging network, which undoubtedly is not making a profit, but they do, because having one entry to secure, encrypted communication fits well with the Apple Experience. iMessage did so well at abstracting the ugly details of encryption that few people even think about that that's what the blue bubble is actually about, it more or less only means your message is end to end encrypted. As a side effect you can also send full resolution images (and more), but that's in no way unique to iMessage.
- thefz 3y ago> The promise of privacy is one way in which they position themselves, but I would not bet the bank on that being true forever. Everybody so quick to forget Apple was/is part of PRISM like any other company.
- heresie-dabord 3y ago> The promise of privacy is one way in which they position themselves, but I would not bet the bank on that being true forever. Indeed. Privacy starts with architectural fundamentals that are very difficult to retrofit... If a supplier of products has not built the products this way, it would be naive to bet bank or farm on the supplier. Even if there were profound motivation to retrofit. Add to this the general tendency of the market to exploit its customers.
- oorza 3y ago> The promise of privacy is one way in which they position themselves, but I would not bet the bank on that being true forever. There are a ton of us out here that consciously choose Apple because of their position on privacy. I have to imagine they know how many customers they'll lose if they ever move on this, and I want to believe that it's a large enough percentage to prevent it from happening. Certainly my circle is not a useful sample, but the Apple people in it are almost all Apple people because of privacy.
- Guthur 3y agoThat is not where Apple's growth has been for quite some time, it's services. And because of that I'll be awaiting the economic rental strategy to come at any moment.
- ethagknight 3y agoNearly 1/4th of their revenue is Apple services, and its their primary source of revenue growth to feed the beast.
- dabbz 3y agoWhen I was at Apple for a short time, there was a small joke I hear from the ex-amazonians there who would say "What's the difference between an Apple software engineer and an Amazon software engineer? The Amazon engineer will spin up a new service on AWS. An Apple engineer will spin up a new app". Or something along those lines. I forget the exact phrasing. It was a joke that Apple's expertise is in on-device features, whereas Amazon thrives in the cloud services world.
- golergka 3y agoWhat would a Google engineer do? Write a design doc or sunset a service?
- amelius 3y agoWhat do you mean luxury? Samsung produces phones that are 2x more expensive and are more luxurious. E.g. Apple still doesn't offer a flipphone that turns into a tablet when you open it.
- veunes 3y ago> The promise of privacy is one way in which they position themselves Yep, the claim to prioritize privacy is a key selling point for them