3 ms·

I pretty strongly disagree. First, from an accuracy perspective, Google Assistant has gotten much better. It almost never misunderstands me, even when I'm mumbl

I pretty strongly disagree. First, from an accuracy perspective, Google Assistant has gotten much better. It almost never misunderstands me, even when I'm mumbling and I'm surprised it can understand me. I do agree that the set of actions I use Google assistant for is pretty static and are the same ones everyone else uses it for: What's the weather? Set my alarm? What's the first item on my calendar? Play XYZ on Spotify... But I don't see this at all as a "failed experiment". On the contrary, I see it as a successful experiment, at least from a human utility perspective: I ask it to do a concrete task, and it does it. The reason it's failed from a larger business perspective is because the format is less amenable to big tech sucking any more of our money or mind out of it. But I say Amen to that! Wherever I go I feel like tech interfaces get relentlessly shittier as they just try to hook us into more mindless scrolling (this HN post on the topic is one of my favorites of all time: https://news.ycombinator.com/item?id=37509507 https://news.ycombinator.com/item?id=37509507) That's just fundamentally harder to do with a voice assistant because nobody has yet figured out how to plug in voice "algorithms" in a way that would make the device control you like they do with YouTube, TikTok, Facebook, etc. If anything, I think the rest of tech that gets you to do things you really don't want to do should be the thing that's considered a "failed experiment".

modeless 3y ago
I agree that its transcribing accuracy is better (largely thanks to general progress in neural nets rather than anything Assistant did as a product). However transcription accuracy was already surprisingly good many years ago, and in my experience any improvement since has been swamped by actually reduced reliability in understanding intent and performing actions. Ultimately it doesn't matter if it misheard me or got the words correct but misinterpreted the meaning or simply failed due to internal errors. The user experience is similarly bad in all these cases. Also I don't feel that hotword detection has improved much, and hotword issues continue to be a big pain point for me. I'm sure the team has a dashboard somewhere that shows consistent gains in their hotword metrics, but as a user I don't feel it at all. The reason I say it's a failed experiment is that the original ambition was to build the Star Trek computer (explicitly, in Google's case: the project was code named "Majel"), and it hasn't worked out. There may be a couple of features that are somewhat convenient (which, again, largely worked fine already a decade ago) but they don't come close to justifying the level of resources spent on these projects over the last decade.
- nirimda 3y ago
  One difference I have noticed is that it used to be when I said "five minute timer" it would maybe ten percent of the time hear "five minutes timer" and decide it should search youtube for matching videos. Nowadays, it seems to treat "five minutes timer" and "five minute timer" as equal, but I get more silent misses where it ignores everything I said. On the other hand, I gave up some kinds of requests. For instance, I used to try "start directions home" when I was driving and it would say "here's a route I found, do you want to start (or some such)" and there would be no way to actually start the directions home without breaking the very expensive law against touching your phone while driving. Does that work today? I don't know, because I've mostly been driving with Android Auto in the last few years and my wife's been in the car on the rare occasion I haven't. But it seems like the Assistant team could straightforwardly improve it.
  - Doxin 3y ago
    > On the other hand, I gave up some kinds of requests. Those kinds of things seem to work absolutely flawlessly for me lately. I had similarly given up on those requests. Heck I had given up on setting timers since that just plain stopped working. A month ago or so I tried changing navigation by voice while driving and to my surprise it worked fine. Since then I've been picking up my use of the assistant more and have yet to have a miss. My main gripe is the trigger word being kinda iffy at times, but I suspect that's due to me still rocking the original pixel. As I understand it the trigger word stuff runs locally so is dependent on your hardware being good.
hulitu 3y ago
> I do agree that the set of actions I use Google assistant for is pretty static and are the same ones everyone else uses it for: What's the weather? Set my alarm? What's the first item on my calendar? Play XYZ on Spotify... But I don't see this at all as a "failed experiment" So since 10 years, all it can do is play some music and tell the weather, all of this only online, so it is not a failed experiment. /s
- vineyardmike 3y ago
  Yea! A product that has become pervasive in most households in America, that does it's one task, and tries to do it well. The problem is that companies built out these organizations and marketed these products as the next step of computing after mobile, and it's just not that easy to monetize. My washer/drier, "all it can do" is spin clothes around and apply heat. I paid a lot more money for that "failed experiment". I think Apple really should have made the HomePod earlier, and all this could be avoided. They were heavily criticized for not supporting 3P "skills" when it came out. Today, Apple is one of the better sellers, and has properly managed their products expectation from the start.
  - pests 3y ago
    Why involve voice at all? Sounds like it needs about 4 buttons.
    - BossingAround 3y ago
      Sounds like all we needed were really fast horses too.
      - pests 3y ago
        Except they didn't invent a car. They invented a complex device to drive the existing horses.
        BossingAround 3y ago
ChildOfChaos 3y ago
Google assistant is awful via the nest mini, I'd hard disagree that the accuracy has gotten better. I ask it for the time and it quotes some article on wikipedia about what time is or various movies with time in the name. I ask it to turn of the lights and it tells me 'power control is not supported yet' at least half the time. It's gotten worse since I bought it, it never did this and that is with even the most basic of tasks.

modeless 3y ago

I agree that its transcribing accuracy is better (largely thanks to general progress in neural nets rather than anything Assistant did as a product). However transcription accuracy was already surprisingly good many years ago, and in my experience any improvement since has been swamped by actually reduced reliability in understanding intent and performing actions. Ultimately it doesn't matter if it misheard me or got the words correct but misinterpreted the meaning or simply failed due to internal errors. The user experience is similarly bad in all these cases. Also I don't feel that hotword detection has improved much, and hotword issues continue to be a big pain point for me. I'm sure the team has a dashboard somewhere that shows consistent gains in their hotword metrics, but as a user I don't feel it at all. The reason I say it's a failed experiment is that the original ambition was to build the Star Trek computer (explicitly, in Google's case: the project was code named "Majel"), and it hasn't worked out. There may be a couple of features that are somewhat convenient (which, again, largely worked fine already a decade ago) but they don't come close to justifying the level of resources spent on these projects over the last decade.

nirimda 3y ago
One difference I have noticed is that it used to be when I said "five minute timer" it would maybe ten percent of the time hear "five minutes timer" and decide it should search youtube for matching videos. Nowadays, it seems to treat "five minutes timer" and "five minute timer" as equal, but I get more silent misses where it ignores everything I said. On the other hand, I gave up some kinds of requests. For instance, I used to try "start directions home" when I was driving and it would say "here's a route I found, do you want to start (or some such)" and there would be no way to actually start the directions home without breaking the very expensive law against touching your phone while driving. Does that work today? I don't know, because I've mostly been driving with Android Auto in the last few years and my wife's been in the car on the rare occasion I haven't. But it seems like the Assistant team could straightforwardly improve it.
- Doxin 3y ago
  > On the other hand, I gave up some kinds of requests. Those kinds of things seem to work absolutely flawlessly for me lately. I had similarly given up on those requests. Heck I had given up on setting timers since that just plain stopped working. A month ago or so I tried changing navigation by voice while driving and to my surprise it worked fine. Since then I've been picking up my use of the assistant more and have yet to have a miss. My main gripe is the trigger word being kinda iffy at times, but I suspect that's due to me still rocking the original pixel. As I understand it the trigger word stuff runs locally so is dependent on your hardware being good.

hulitu 3y ago

> I do agree that the set of actions I use Google assistant for is pretty static and are the same ones everyone else uses it for: What's the weather? Set my alarm? What's the first item on my calendar? Play XYZ on Spotify... But I don't see this at all as a "failed experiment" So since 10 years, all it can do is play some music and tell the weather, all of this only online, so it is not a failed experiment. /s

vineyardmike 3y ago
Yea! A product that has become pervasive in most households in America, that does it's one task, and tries to do it well. The problem is that companies built out these organizations and marketed these products as the next step of computing after mobile, and it's just not that easy to monetize. My washer/drier, "all it can do" is spin clothes around and apply heat. I paid a lot more money for that "failed experiment". I think Apple really should have made the HomePod earlier, and all this could be avoided. They were heavily criticized for not supporting 3P "skills" when it came out. Today, Apple is one of the better sellers, and has properly managed their products expectation from the start.
- pests 3y ago
  Why involve voice at all? Sounds like it needs about 4 buttons.
  - BossingAround 3y ago
    Sounds like all we needed were really fast horses too.
    - pests 3y ago
      Except they didn't invent a car. They invented a complex device to drive the existing horses.
      - BossingAround 3y ago

ChildOfChaos 3y ago

Google assistant is awful via the nest mini, I'd hard disagree that the accuracy has gotten better. I ask it for the time and it quotes some article on wikipedia about what time is or various movies with time in the name. I ask it to turn of the lights and it tells me 'power control is not supported yet' at least half the time. It's gotten worse since I bought it, it never did this and that is with even the most basic of tasks.