6 ms·
> When the app matched his photos of the backyard mushrooms with an edible species, [...] it almost killed him. Now there's an app that'd have to be designed v
by neilv 4y ago
> When the app matched his photos of the backyard mushrooms with an edible species, [...] it almost killed him.
Now there's an app that'd have to be designed very conscientiously.
- creepycrawler 4y agoInstead of a general mushroom identification app, it could be a poisonous mushroom identification app. The dataset would only include poisonous mushrooms, and it will be made clear that it is not exhaustive. This could be useful to rule out some mushrooms.
- SpikeDad 4y agoWow. Who would take the liability of an app such as this? Regardless of how many disclaimers you'd have to agree to I could easily see a jury holding the creator of the app liable for a horrible death like that.
- caust1c 4y agoIt's literally part of the iphone camera, if you weren't aware. Not disagreeing with you, but acknowledging that it's pretty hard to prevent these apps with how accessible machine learning is today, despite accuracy still being difficult for many things.
- csydas 4y agoI dunno, watching the video linked by this use [0], I think the apps (aside from Google Lens) do a fairly okay job of being clear that they aren't as sure on their identification and that they're about casualness, not "safe to eat or not safe to eat." While the article cites some persons who ate poisonous mushrooms because an app said they weren't poisonous, ultimately it will come down to "Did the app sell itself as telling you what's safe to eat and what's not?" From the video, I'm particularly harsh towards Google on this as it doesn't seem to include the confidence level or analysis process and instead focused on showing a result and even trying to sell you something based on the result. This does seem like it's the wrong approach that will get people killed, with thoughts like "well Google thinks it's this, and it's even trying to sell me some, so must be okay." For the others, you can see warnings in the apps about eating identified stuff, you can see how confident it is in the analysis, and they at least appear to be considering things like the region you're in when making an analysis. I think it would be fairly defensible based on the warnings and preparation that a reasonable person would not be expected to take the identification as a go-ahead to eat something. That unreasonable persons take unreasonable actions as a result of these apps wouldn't really change the legal interpretation, but of course maybe it can be persuasive in other directions. At first I shared the same opinion as you that these are dangerous apps, but watching what the apps do in the linked video, the non-google ones are actually pretty acceptable in my opinion. I would prefer they include a few more warnings though when there is low confidence matching or when there is conflicting matching just to remind the person using the app "hey, btw, a lot of plants can kill you. Don't eat this, I'm just an app." [0] - https://news.ycombinator.com/item?id=33220688 https://news.ycombinator.com/item?id=33220688
- chernofool 4y agoMost plant ID apps have a disclaimer saying that you should never eat anything that you use the app to identify. Seek reminds you every time you open the camera. They're mostly intended as entertainment, but some of them use the data to analyze where species are growing in realtime.
- colechristensen 4y agoHonestly though there should be limits to the amount that a disclaimer should be able to protect you when your product advises people to do dangerous things you know (or have every responsibility to know) could be lethal. There’s a lot of room between a one in a billion mistake that hurts somebody and a fifty fifty chance a mushroom is poisonous. There are plenty of edible vs deadly mushrooms that only have incredibly subtle differences that you should trust nobody but a human expert to identify. Effectively what I’m saying is a disclaimer shouldn’t be able to get you out of murder charges for a game of Russian roulette.
- deleted 4y ago[deleted]
- Dylan16807 4y agoIt identifies plants and animals. The main use is not for finding food. "advises people to do dangerous things" is a ridiculous way to describe it.
- uwagar 4y ago>Effectively what I’m saying is a disclaimer shouldn’t be able to get you out of murder charges for a game of Russian roulette. By your logic knife makers will all be praying that their knives arent used for killing or harming people or they'd be charged for murder.
- colechristensen 4y agoThis isn’t at all the case. These identification apps are selling incomplete information where the need for full information about toxins is obvious. Nobody was ever surprised that a knife hurt somebody or had cause to accuse a knife maker that their product could cut things in a way a consumer wouldn’t know about. The issue isn’t that a tool can be harmful but that a danger to the producer of a product would be obligated to know and share isn’t obvious to the consumer without previous knowledge. If you’re selling information you must know your audience. Any human teaching you to identify mushrooms will teach you about the risks of poison right away. “I didn’t tell you what you needed to know but you should have known better” only works when it’s reasonable for you to know better. General audience mushroom identifiers shouldn’t be expected to know how easily a misidentification could kill them, plus it’s just not difficult to do. This doesn’t match the situation with knives unless you can find me someone who really does need to be warned about knives and isn’t, say, 4 years old.
- smegsicle 4y agoa mushroom identification app that doesn't draw attention to toxic lookalikes sounds pretty close to criminally negligent
- DangitBobby 4y agoAnd this is why we can't have nice things. This opinion is wild to me. You do not trust a consumer app with life and death decisions, especially over something where the potential upside is getting to eat a mushroom you found and the potential downside is death. Making more criminals is not the answer.
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- colechristensen 4y agoA very important fact you need when identifying mushrooms is the consequences of misidentifying them. You don’t have “nice things” when you fail to raise this crucially important point. Every responsible resource will be full of this kind of caution and neglecting it should be criminal. It isn’t covering your ass or putting an obligatory warning label on everything, a primary point of interest in mushroom identification is toxicity. If you don’t do it you kill people, not like maybe but certainly.
- DangitBobby 4y agoEh, no, you're inventing a narrative. The guy knew the downside actually or he wouldn't have bothered to use the app to identify it. He knew the downsides, he rolled the dice, he lost. His wife knew the downsides, didn't roll the dice, and he thankfully lived maybe because of that. You also don't know that the app doesn't warn users that it shouldn't be used in life and death situations, but I'll maintain that it shouldn't have to. To avoid "criminal negligence" accusations. If I have a rock identification app does it need to say not to eat rocks to avoid liability for dental damages? If I sell bicycles do I have to tell you that rolling downhill fast can cause death or injury?
- cyphar 4y agoSome time ago, I somehow ran into a YouTuber who talks about foraging in the UK talking about how effective these apps are[1]. Each one of them misidentified at least one plant, and two of three gave incorrect (or misleading) results for the deadly plant he tested. However he made the very interesting point that having an app tell you if something is edible is a completely incorrect starting point for foraging because the main thing you get from using a reference book is that you are forced to notice that there are many plants that may look similar but are different (meaning you are more aware that your task is more about differentiation than identification, since botany is a bit fuzzy around the edges) and might seriously differ in their toxicity. None of these apps have a feature to say "it looks like this edible plant but if the angle you took the photo from was slightly off, it's definitely poisonous because the group of plants that look like this only only one or two edible members and everything else will definitely kill you". Some list confidence percentages but there were examples where the percentages were far too pessimistic or optimistic for a certain match, making them not particularly useful. My impression is that these apps are developed using the same "move fast and break things" model as most other things these days, which definitely seems like the best model to use when making an app that may or may not lead to people's deaths (not your fault of course, because you waived all liability in your ToS). /s [1]: https://youtu.be/sjS0PgC9KSc https://youtu.be/sjS0PgC9KSc
- WalterBright 4y agoI've tried to identify hemlock from photos, without much success in distinguishing them from a carrot. I'll just stick to distinguishing a '67 from a '68 Mustang.