6 ms·

Nice concept. Unfortunately, I have tried to identify some of my plants but it could not identify correctly a single one. Just an endless procession of at best

Nice concept. Unfortunately, I have tried to identify some of my plants but it could not identify correctly a single one. Just an endless procession of at best similar plants, most of the time completely dissimilar. I think this is another naive model that just tries to push entire problem to AI. That is unfortunately what I am seeing nowadays, very unimaginative. Just try to have fun with parameters of the network until you find some kind of configuration that seems to be working. What it would benefit from would be some kind of analysis/classification of basic features of the plants like what's the basic shape of the leaf, trunk, how things are connected, etc. The classification would benefit from AI (like identify where leaves are, where trunk is, etc.) but then that intel would be passed to a more classification-oriented algorithm. (disclaimer, I am not an AI developer, it just seems to me like pretty rational way to approach the problem)

phito 5y ago
Right. This kind of thing is only going to work on very common plants that are easy to ID. I am very into carnivorous plants and even us experts sometimes have trouble identifying plants, often you need very specific morphological details to ID species that a phone picture will never be able to catch. IMO this will just lead people to wrongly ID their plants more often than not, and that's a really bad thing.
- jazzyjackson 5y ago
  The iNaturalist app does a spectacular job at identifying plants (and insects, fish, birds…), even disambiguating based on your location You label geotagged images with the AIs suggestion if you agree with it and then other users can either confirm or suggest a different / more specific species.
  - phito 5y ago
    You got me curious, so I tried that app, and I'm getting "Unknown species" for every single one of my plants... I guess no identification is better than bad identification.
    - lmilcin 5y ago
      It is an important feature. For plants, users will immediately see that the answer is wrong but for many other things (identifying suspects automatically) it might not be as obvious. As a bonus if the algorithm can tell it can't identify correctly you can use this feedback to teach the algorithm.
      - bottled_poe 5y ago
        A great example of this is the Akinator app. The developers built up a database of answers by getting the users to fill in the missing data, which produced more accurate results and subsequently attracted more users. That feedback loop for apps like this seems like a very effective model. What I find interesting about this is that the value of the product, from a business perspective, comes from the success of the software in enabling that feedback loop, while from the user’s perspective, the value is in the data. But the data is emergent from the feedback algorithm.
    - abeppu 5y ago
      Is it perhaps also a difference in intended use? If iNaturalist is for wildlife and uses location heavily, eg identifying tropical houseplants indoors in a different region might not work.
      - phito 5y ago
        Could be, I just set location data on it with the original location of the plants, but it still cannot ID them. Granted, they are not very common species.
      - jazzyjackson 5y ago
        The GPS helps with a “seen nearby” weight, but it shouldn’t exclude anything. Could be a factor of photography, with some plants it’s easier to get a nice canonical leaf shape than others. Taking a wide angle of a potted plant such that the whole plant is in frame might not provide enough detail, so there’s a learning curve in knowing how to photography for the algorithms benefit, kind of like learning how to phrase search queries for better Google results
- jvvw 5y ago
  I've used PictureThis a great deal to identify both wild and garden flowers. I've found it really good for the 95% most common plants and also for getting you in the right ballpark so you can then look things up more easily in a field guide. I've just accepted that there are some species that it can't distinguish between - often you need to know exactly the right feature to look at of the plant to differentiate species. It'd be useful though if it flagged this a bit better. Umbellifers are a classic example. It gets them correct more often than not, but I think it'd be good for it to indicate that uncertainty better.
- radec 5y ago
  Not sure if this will put your mind at ease or not. But I really like learning plants, I hike a lot and usually the only book I bring is a plant ID book. But I'm not good at knowing where to start looking in the book. I find apps like this (I use Seek) incredibly helpful, I don't just assume the app is correct but it gives me a place to start looking in the book. That said, I also don't assume I'm correct when I find what I think it is in the book. Anyway just wanted to say I find plant I'd apps a helpful learning tool. I will say though, most of the time I don't have service where I'm IDing plants, so it's not the most convenient tool.
Tenoke 5y ago
>What it would benefit from would be some kind of analysis/classification of basic features of the plants like what's the basic shape of the leaf, trunk, how things are connected, etc. There's no reason to think that needs to be done separately, and in fact that's the kind of things that you'd expect a good model to find on its own. In general, we've already learned that while handcrafted features can help, they are often ultimately worse than learned ones as techniques get better.
- lmilcin 5y ago
  AIs are useful for "fuzzy" problems, but are not very good at doing precise things with high reliability. Every plant has baked in restrictions on how it grows. If you can identify separate features of a leaf and how the leaf grows out of the stem you can basically look it up in a table and tell what kind of tree you are looking at, without need for guessing. On the other hand AI will develop its own classification method but one that has unknown faults in it. Maybe it has learned to look at the lighting direction because half of the data set was non-suculents with light from the left and half was succulents with light from the right, because it came from a different facility? Or maybe different cameras were used to photograph different types of plants? So now rather than looking at the leaves it uses light direction or photo grain to tell if it is succulent or not? Face the reality, you are wrong. The above algorithm returns completely nonsensical results for my searches, plants that have completely different structure and coloration and nobody would ever mistake them. It relies at you looking at the suggested solution, and then, Hey!, here you have five more, maybe your plant is somewhere on the list? This is only marginally useful but could have been so much better if it tried to identify structure of the plant.
  - IgorPartola 5y ago
    Would it be possible to train the model to identify the features and then just have it run those through a trie of plant classifications? Trying to bake classifications into the model does seem silly but you still need an element of computer vision if you want to do this.
    - 5y ago
Fiahil 5y ago
To be honest, nothing works better than Plantnet for identifying plants. They do the pre-selection where you choose wich organ you're looking at (trunk, leaf, flower, fruit, ...).
- CTOSian 5y ago
  Plantnet is a gem, they don't even want you to "register"/"connect with FB/Google" for "tracking" purposes
  - ornornor 5y ago
    I think it’s a research project and not a commercial VC-money-burning startup. I highly recommend PlantNet as well.
_Microft 5y ago
Flora Incognita, a free plant identification app for Android and iOS, developed by a German university, does that. You choose a category first, like "tree", "flower", "grass" or "fern" and it will guide you through the process, trying to identify the plant with as few photos as necessary. Common ones it will identify from a single image, for others, it will e.g. prompt to take a close-up photo of the bark, bloom or the complete plant in its environment. From what I understand, they are aiming for accuracy of the identification and will provide a description of possibly matching plants if there is still ambiguity. Very recommended! Edit: here is a link if it sounds interesting: https://floraincognita.com https://floraincognita.com
- swader999 5y ago
  This will bolster my fantasy of living off the land like the savage I want to be.
- ewokone 5y ago
  Thanks for pointing out!
- nend 5y ago
  I've been using an app called PlantNet that works similarly. Upload a photo, tell the app which part of the plant is in the photo (leaf, flower, fruit, bark), and it'll tell you what the plant is. Highly recommended as well, almost always identifies the plant with just one photo. I'll have to check out flora incognita sometime.
  - ogrisel 5y ago
    plantnet works very well. I have also used Google Lens (the magic button on Google Photos on Android) but I have the subjective feeling that plantnet works more reliably for plant identification.
  - bwanab 5y ago
    I’ve been amazed at how well PlantNet works. It’s identified a number of invasive species in my yard that I’d otherwise have remained ignorant of.

phito 5y ago

Right. This kind of thing is only going to work on very common plants that are easy to ID. I am very into carnivorous plants and even us experts sometimes have trouble identifying plants, often you need very specific morphological details to ID species that a phone picture will never be able to catch. IMO this will just lead people to wrongly ID their plants more often than not, and that's a really bad thing.

jazzyjackson 5y ago
The iNaturalist app does a spectacular job at identifying plants (and insects, fish, birds…), even disambiguating based on your location You label geotagged images with the AIs suggestion if you agree with it and then other users can either confirm or suggest a different / more specific species.
- phito 5y ago
  You got me curious, so I tried that app, and I'm getting "Unknown species" for every single one of my plants... I guess no identification is better than bad identification.
  - lmilcin 5y ago
    It is an important feature. For plants, users will immediately see that the answer is wrong but for many other things (identifying suspects automatically) it might not be as obvious. As a bonus if the algorithm can tell it can't identify correctly you can use this feedback to teach the algorithm.
    - bottled_poe 5y ago
      A great example of this is the Akinator app. The developers built up a database of answers by getting the users to fill in the missing data, which produced more accurate results and subsequently attracted more users. That feedback loop for apps like this seems like a very effective model. What I find interesting about this is that the value of the product, from a business perspective, comes from the success of the software in enabling that feedback loop, while from the user’s perspective, the value is in the data. But the data is emergent from the feedback algorithm.
  - abeppu 5y ago
    Is it perhaps also a difference in intended use? If iNaturalist is for wildlife and uses location heavily, eg identifying tropical houseplants indoors in a different region might not work.
    - phito 5y ago
      Could be, I just set location data on it with the original location of the plants, but it still cannot ID them. Granted, they are not very common species.
    - jazzyjackson 5y ago
      The GPS helps with a “seen nearby” weight, but it shouldn’t exclude anything. Could be a factor of photography, with some plants it’s easier to get a nice canonical leaf shape than others. Taking a wide angle of a potted plant such that the whole plant is in frame might not provide enough detail, so there’s a learning curve in knowing how to photography for the algorithms benefit, kind of like learning how to phrase search queries for better Google results
jvvw 5y ago
I've used PictureThis a great deal to identify both wild and garden flowers. I've found it really good for the 95% most common plants and also for getting you in the right ballpark so you can then look things up more easily in a field guide. I've just accepted that there are some species that it can't distinguish between - often you need to know exactly the right feature to look at of the plant to differentiate species. It'd be useful though if it flagged this a bit better. Umbellifers are a classic example. It gets them correct more often than not, but I think it'd be good for it to indicate that uncertainty better.
radec 5y ago
Not sure if this will put your mind at ease or not. But I really like learning plants, I hike a lot and usually the only book I bring is a plant ID book. But I'm not good at knowing where to start looking in the book. I find apps like this (I use Seek) incredibly helpful, I don't just assume the app is correct but it gives me a place to start looking in the book. That said, I also don't assume I'm correct when I find what I think it is in the book. Anyway just wanted to say I find plant I'd apps a helpful learning tool. I will say though, most of the time I don't have service where I'm IDing plants, so it's not the most convenient tool.

Tenoke 5y ago

>What it would benefit from would be some kind of analysis/classification of basic features of the plants like what's the basic shape of the leaf, trunk, how things are connected, etc. There's no reason to think that needs to be done separately, and in fact that's the kind of things that you'd expect a good model to find on its own. In general, we've already learned that while handcrafted features can help, they are often ultimately worse than learned ones as techniques get better.

lmilcin 5y ago
AIs are useful for "fuzzy" problems, but are not very good at doing precise things with high reliability. Every plant has baked in restrictions on how it grows. If you can identify separate features of a leaf and how the leaf grows out of the stem you can basically look it up in a table and tell what kind of tree you are looking at, without need for guessing. On the other hand AI will develop its own classification method but one that has unknown faults in it. Maybe it has learned to look at the lighting direction because half of the data set was non-suculents with light from the left and half was succulents with light from the right, because it came from a different facility? Or maybe different cameras were used to photograph different types of plants? So now rather than looking at the leaves it uses light direction or photo grain to tell if it is succulent or not? Face the reality, you are wrong. The above algorithm returns completely nonsensical results for my searches, plants that have completely different structure and coloration and nobody would ever mistake them. It relies at you looking at the suggested solution, and then, Hey!, here you have five more, maybe your plant is somewhere on the list? This is only marginally useful but could have been so much better if it tried to identify structure of the plant.
- IgorPartola 5y ago
  Would it be possible to train the model to identify the features and then just have it run those through a trie of plant classifications? Trying to bake classifications into the model does seem silly but you still need an element of computer vision if you want to do this.
  - 5y ago

Fiahil 5y ago

To be honest, nothing works better than Plantnet for identifying plants. They do the pre-selection where you choose wich organ you're looking at (trunk, leaf, flower, fruit, ...).

CTOSian 5y ago
Plantnet is a gem, they don't even want you to "register"/"connect with FB/Google" for "tracking" purposes
- ornornor 5y ago
  I think it’s a research project and not a commercial VC-money-burning startup. I highly recommend PlantNet as well.

_Microft 5y ago

Flora Incognita, a free plant identification app for Android and iOS, developed by a German university, does that. You choose a category first, like "tree", "flower", "grass" or "fern" and it will guide you through the process, trying to identify the plant with as few photos as necessary. Common ones it will identify from a single image, for others, it will e.g. prompt to take a close-up photo of the bark, bloom or the complete plant in its environment. From what I understand, they are aiming for accuracy of the identification and will provide a description of possibly matching plants if there is still ambiguity. Very recommended! Edit: here is a link if it sounds interesting: https://floraincognita.com https://floraincognita.com

swader999 5y ago
This will bolster my fantasy of living off the land like the savage I want to be.
ewokone 5y ago
Thanks for pointing out!
nend 5y ago
I've been using an app called PlantNet that works similarly. Upload a photo, tell the app which part of the plant is in the photo (leaf, flower, fruit, bark), and it'll tell you what the plant is. Highly recommended as well, almost always identifies the plant with just one photo. I'll have to check out flora incognita sometime.
- ogrisel 5y ago
  plantnet works very well. I have also used Google Lens (the magic button on Google Photos on Android) but I have the subjective feeling that plantnet works more reliably for plant identification.
- bwanab 5y ago
  I’ve been amazed at how well PlantNet works. It’s identified a number of invasive species in my yard that I’d otherwise have remained ignorant of.