5 ms·
TBH I always feel amazed about how worked up people get about stuff like this, especially people familiar with software who should know that there are millions,
by hn_throwaway_99 7y ago
TBH I always feel amazed about how worked up people get about stuff like this, especially people familiar with software who should know that there are millions, maybe billions of edge cases like this in a generic knowledge system, and thus at least it's easy to make a mistake like this. I mean, the time it took him to write his blog post is probably more than all the times it would take him to follow up with "What time is it in London, England?" It reminds me of someone who commented that "there must not be any black people who work at Apple" because it pronounced "Malcolm X Blvd" as Malcolm 10 Blvd.
I mean, if anything, just appreciate how amazing humans are at differentiating these ambiguities.
- recursive 7y agoJust because it's hard to implement right doesen't mean Apple should get a pass. I mean, they aren't forced to create a voice assistant by regulation. If they can't make a good one, (and this applies to Amazon and Microsoft too) they should have just left it in the lab until they can.
- hn_throwaway_99 7y ago> they should have just left it in the lab until they can. Totally disagree, because the only way these assistants get better is with real-world usage (which is why I can definitely agree that one should wonder why Apple isn't improving as fast as the competition). It was only a couple years ago that using Google Assistant was an extremely frustrating experience. I'd say it got about 5-10% of my words wrong, which meant it got my intent wrong about 25-35% of the time. These days I find its accuracy uncanny - it almost never makes a mistake with most of my "standard" queries. No way it could have gotten that good without real-world feedback and data.
- jordanpg 7y agoIt is still an extremely frustrating experience. All of them: Google, Amazon, Apple. That it gets it wrong, ever, is too much for me. The first time I ever had to repeat myself getting directions on the road I was done. I don't understand why anyone other than hobbyists can stand to use these things. They are so obviously years away from ready for serious use, and the novelty value wore off years ago. Not shitposting here, these are serious comments about absurdly bad UX.
- hn_throwaway_99 7y ago> That it gets it wrong, ever, is too much for me. The first time I ever had to repeat myself getting directions on the road I was done. How can you stand to deal with humans?
- schrodinger 6y agoHumans are so many orders of magnitude better at comprehension that your comment feels a bit disingenuous.
- hn_throwaway_99 6y agoI was replying to the parent comment that said that basically any errors were unacceptable, and that ever having to repeat himself was a deal breaker. This seems like a ridiculous position to me given that, as you point out, humans are much better at comprehension, and even they can't hit this standard.
- astrea 7y agoSo they should go completely counter to the way that businesses traditionally function and keep something in a lab for potentially decades instead of shipping a "good enough" solution that can be fixed along the way? Especially one that would get valuable information and edge cases from a live system? It's not like it's safety critical software. It's neat to have, sure, but you won't die if you get the wrong London's time.
- recursive 7y ago> shipping a "good enough" solution I think the debate here is about whether anything has shipped that is actually "good enough". I don't think it's that controversial to avoid shipping stuff that's not good enough.
- astrea 7y agoI think it's good enough. Sure, in this very cherry-picked example it fails. But for a lion's share of functionality it works just fine.
- ken 7y agoBut the post points out that Siri from other Apple devices gets it right. Apple’s “generic knowledge system” can answer this. It’s only Apple Watch which has trouble. That’s kind of weird. It’s not that Siri is especially bad. It’s that “Siri” is something different depending on how you query it. Other online search systems aren’t like that, and integration and consistency are typically Apple’s forte.
- hn_throwaway_99 7y agoSeems like an easy plausible explanation is mobile devices (like a watch or phone) take your current location into account, while a stationary device (like a HomePod) does not. Look, I'm not arguing it's not a bug, but I'm just really surprised at how software people, who I think should know better, are surprised that such bugs exist, or more importantly that completely eliminating all types of this class of bugs is basically impossible with current technology.
- saagarjha 7y agoSiri is often self-inconsistent. Ask a query again on the same device and you might get a completely different answer.
- odysseus 6y agoExactly. I'll speak into my AirPods "Hey Siri, 30 minute outdoor walk" to start a 30 minute workout on my Apple Watch. Half the time, Siri replies with "I'm sorry, you don't have an app for that. You can try searching for one on the app store." Repeat the same exact query to the AirPods seconds later, and bam, it starts the workout on the Apple Watch.
- ken 7y agoAnswering (with a human voice!) the correct time zone for the wrong "London" is about the mildest possible bug you'll ever see. I might not even call it a "bug". Let's call it a mild inconvenience of modern life! The aspect that's ruffling feathers, I believe, is that it's one of those cases where someone might have reasonably assumed something was built one way 'under the hood', and was confronted with an effect which forced them to see that it was not implemented that way at all. The issue isn't the 'bug'. It's the realization that their mental model was wrong. Specifically, something has a name ("Siri") which might lead one to believe that everything from that manufacturer using that name refers to the same thing. (Isn't that the point of a name?) Clearly, it's not. Your hypothesis sounds plausible, so I tested it. I have a Mac laptop, which has the same 'Location Services' that iOS has (AFAIK). I asked Mac Siri what time it is in London, and got a response for the one in England (further away from me). So that doesn't explain it, or at least not all of it.
- emiliobumachar 7y agoSiri may be a marvel of modern technology. If the competition does better, than it's reasonable to complain about Siri.
- krick 7y agoThat's actually a pretty typical blog post for this guy. So I'd say it's more like "some people", not just "people".
- snowwrestler 7y agoI agree with you, but then consider all the influential people who think the exact same category of technology--AI aka machine learning--will produce a self-driving car that is safer than human drivers, or take away every human job in X years. I think it's very worthwhile to point out these seemingly basic errors as a way to maintain appropriate skepticism about the limits of our technology.
- giarc 6y agoBut if you are Apple and building the Siri product, you think this would be one of the first use cases you would develop and/or test. I remember asking Siri to convert a currency for me and it just showed me search results for 'currency conversion'. Again... wouldn't this be a query you would test for?
- wrsh07 6y agoNo way This is the difference between a usable product and something that is not If my voice assistant is going to make a significant % of errors, it either needs to be very cheap for me to correct it (it's not -- usually you retry and if it keeps failing what do you do?) or I'm going to stop using it Steve Jobs made great, not passable, products. It's a shame that Siri is so far behind