5 ms·

Hallucinations would be terrible for brand appeal beyond being limited. Nobody has solved that problem yet. Just take a look at Google’s latest search results g

by dagmx 2y ago

Hallucinations would be terrible for brand appeal beyond being limited. Nobody has solved that problem yet. Just take a look at Google’s latest search results giving actively harmful information.

threatofrain 2y ago
I suspect that current ML tech is good enough to constitute a big discrete step forward in terms of how much value Siri is providing as a digital assistant that's also in charge of your home. If that's the case, there's more harm in being reputed as the company that is one serious step behind in a space that isn't yet settled vs facing the same level of gaffs that Google and Microsoft are putting out. Just look at Microsoft right now. They're experiencing all the heat that OpenAI brings, including unforced errors like Sky. Reputationally speaking, are they better or worse off having made such an early push for LLM product integration?
- dagmx 2y ago
  I would argue that Microsoft do not have the same brand that Apple does. So they’re much more free to pursue OpenAI partnerships regardless of how well it works. I don’t mean brand as in purely recognition, but what it means to people. Apple are held to a higher standard because of the specific identity they’ve cultivated. (Arguing the specifics of whether that’s deserved or not will be its own essay so I’m leaving that out) You see this all the time on HN or Reddit, where any negative subject about Apple gains significantly more traction than other companies. Meanwhile Microsoft has an identify that is more “meh”. Users expect Microsoft products to not have the polish, to have ads and be weird/quirky. Microsoft did Windows phone and the zune, Apple did the iPhone and the iPod. Does that mean one companies products are better or worse? Maybe? Maybe not. But it does mean that the brand appeal of every company has different characteristics that need to be accounted for. Siri giving bad answers is much worse perceptually than Cortana/Bing giving the same answers. It also means Microsoft is more free to experiment and do things that are half baked because their brand identity allows for that. Often that leads to really interesting use cases ahead of its time. I’d also add that Apple being “behind the curve” perceptually has rarely been an issue. The brand is that they enter late and redefine the segment. Again, not always deserved, but that’s the association. They often ride out trends that way.
  - kalleboo 2y ago
    You can see this even with Google vs Microsoft/OpenAI. Google had their LLM chat-bot working internally (remember the ethics guy who got fired because he was so convinced that the chatbot had a soul?), but they clearly thought that the level of hallucinations at the time would be bad publicity as all the news would be "Google's chatbot spews nonsense!". But OpenAI and Bing had nothing to lose, they could launch them with no expectations of quality, taking Google by surprise, and now everyone just says Google was behind instead and had to scramble to catch up. Same thing with Apple - if Apple had launched Siri with GPT-3.0 before ChatGPT, they would have been a laughing stock with how bad it was. But instead now they're behind, even though the competing products are STILL unsuitable.
    - dagmx 2y ago
      Yeah the Google vs OpenAI comparison is really apt. ChatGPT will give terrible hallucinations as well, but Google is getting lambasted right now for theirs. But even then, it’s written off as Google being Google. If Apple did it, it would take over the tech news cycle for weeks. Personally I do think it’s better for Apple to be seen as behind in this trade off.
  - deleted 2y ago
    [deleted]
qingcharles 2y ago
It can't be any worse than how bad Siri and Alexa are right now. Amazon gave me one of those Pop things recently and it was set up with the wrong zip code. I kept asking it for the weather in Chicago, every way that I could think of, but it had no idea what I was trying to ask for. The speaker is great in it, though.
- dagmx 2y ago
  It absolutely can be worse. Right now, their limited subset of answers would be wrong in a way that is easily correctable. They fail safe. An LLM doesn’t fail safe. It fails confidently. Correcting bad responses can be a very expensive and time consuming effort. In the meantime you get actively harmful suggestions: https://arstechnica.com/information-technology/2024/05/googles-ai-overview-can-give-false-misleading-and-dangerous-answers/ https://arstechnica.com/information-technology/2024/05/googl... Alexa telling you the wrong weather is a lot less harmful than it telling you to do something that would harm you (staring at the sun, running with scissors, smoking when pregnant) or spreading political misinformation (telling you conspiracy theories).
JumpCrisscross 2y ago
> Hallucinations would be terrible Tighten the temperature. Everyone is trying to sell AI as AGI. Apple’s genius will be in breaking from that. Simply, dependable, tightly controlled LLM that isn’t even branded as AI. Just a thing that does certain tasks for you better.
kalleboo 2y ago
They could use OpenAI only as the natural language processing part, and constrain it to only using the vetted services/actions that Siri already can do rather than answering open-ended questions. That would still make Siri massively more useful than it is today since it would remove the need to word things in a specific way. It wouldn't be bullet-proof (there are always "jailbreaks" to these kinds of prompts) but it might be good enough if they slap a "beta" tag on it.

by dagmx 2y ago

Hallucinations would be terrible for brand appeal beyond being limited. Nobody has solved that problem yet. Just take a look at Google’s latest search results giving actively harmful information.

threatofrain 2y ago

I suspect that current ML tech is good enough to constitute a big discrete step forward in terms of how much value Siri is providing as a digital assistant that's also in charge of your home. If that's the case, there's more harm in being reputed as the company that is one serious step behind in a space that isn't yet settled vs facing the same level of gaffs that Google and Microsoft are putting out. Just look at Microsoft right now. They're experiencing all the heat that OpenAI brings, including unforced errors like Sky. Reputationally speaking, are they better or worse off having made such an early push for LLM product integration?

dagmx 2y ago
I would argue that Microsoft do not have the same brand that Apple does. So they’re much more free to pursue OpenAI partnerships regardless of how well it works. I don’t mean brand as in purely recognition, but what it means to people. Apple are held to a higher standard because of the specific identity they’ve cultivated. (Arguing the specifics of whether that’s deserved or not will be its own essay so I’m leaving that out) You see this all the time on HN or Reddit, where any negative subject about Apple gains significantly more traction than other companies. Meanwhile Microsoft has an identify that is more “meh”. Users expect Microsoft products to not have the polish, to have ads and be weird/quirky. Microsoft did Windows phone and the zune, Apple did the iPhone and the iPod. Does that mean one companies products are better or worse? Maybe? Maybe not. But it does mean that the brand appeal of every company has different characteristics that need to be accounted for. Siri giving bad answers is much worse perceptually than Cortana/Bing giving the same answers. It also means Microsoft is more free to experiment and do things that are half baked because their brand identity allows for that. Often that leads to really interesting use cases ahead of its time. I’d also add that Apple being “behind the curve” perceptually has rarely been an issue. The brand is that they enter late and redefine the segment. Again, not always deserved, but that’s the association. They often ride out trends that way.
- kalleboo 2y ago
  You can see this even with Google vs Microsoft/OpenAI. Google had their LLM chat-bot working internally (remember the ethics guy who got fired because he was so convinced that the chatbot had a soul?), but they clearly thought that the level of hallucinations at the time would be bad publicity as all the news would be "Google's chatbot spews nonsense!". But OpenAI and Bing had nothing to lose, they could launch them with no expectations of quality, taking Google by surprise, and now everyone just says Google was behind instead and had to scramble to catch up. Same thing with Apple - if Apple had launched Siri with GPT-3.0 before ChatGPT, they would have been a laughing stock with how bad it was. But instead now they're behind, even though the competing products are STILL unsuitable.
  - dagmx 2y ago
    Yeah the Google vs OpenAI comparison is really apt. ChatGPT will give terrible hallucinations as well, but Google is getting lambasted right now for theirs. But even then, it’s written off as Google being Google. If Apple did it, it would take over the tech news cycle for weeks. Personally I do think it’s better for Apple to be seen as behind in this trade off.
- deleted 2y ago
  [deleted]

qingcharles 2y ago

It can't be any worse than how bad Siri and Alexa are right now. Amazon gave me one of those Pop things recently and it was set up with the wrong zip code. I kept asking it for the weather in Chicago, every way that I could think of, but it had no idea what I was trying to ask for. The speaker is great in it, though.

dagmx 2y ago
It absolutely can be worse. Right now, their limited subset of answers would be wrong in a way that is easily correctable. They fail safe. An LLM doesn’t fail safe. It fails confidently. Correcting bad responses can be a very expensive and time consuming effort. In the meantime you get actively harmful suggestions: https://arstechnica.com/information-technology/2024/05/googles-ai-overview-can-give-false-misleading-and-dangerous-answers/ https://arstechnica.com/information-technology/2024/05/googl... Alexa telling you the wrong weather is a lot less harmful than it telling you to do something that would harm you (staring at the sun, running with scissors, smoking when pregnant) or spreading political misinformation (telling you conspiracy theories).

JumpCrisscross 2y ago

> Hallucinations would be terrible Tighten the temperature. Everyone is trying to sell AI as AGI. Apple’s genius will be in breaking from that. Simply, dependable, tightly controlled LLM that isn’t even branded as AI. Just a thing that does certain tasks for you better.

kalleboo 2y ago

They could use OpenAI only as the natural language processing part, and constrain it to only using the vetted services/actions that Siri already can do rather than answering open-ended questions. That would still make Siri massively more useful than it is today since it would remove the need to word things in a specific way. It wouldn't be bullet-proof (there are always "jailbreaks" to these kinds of prompts) but it might be good enough if they slap a "beta" tag on it.