4 ms·
Last time I was sitting in the garden, I was wondering how far we are with actualy understanding the bird chirp and tweets. I felt like there were certain patte
by kriro 3y ago
Last time I was sitting in the garden, I was wondering how far we are with actualy understanding the bird chirp and tweets. I felt like there were certain patterns I could hear repeatedly in certain situations (danger approach warning, feeding communication, always the same sound before one bird flew out and collected food kind of like "make us breakfast" :P).
Unfortunately some quick searches on Google scholar didn't help much, I feel like I'm lacking the right search terms here. Most ML in this area seems to be related to species classification. If there's any bird experts reading, what is the state of the art of "understadning" bird language? Any paper recommendations? I'm curious about basic things like...is there a universal bird language or does each species use their own language (can a crow understand a sparrow), are there some sounds that are identified with meaning etc.
Edit: just checked my bookmarks and "Bird-DB: A database for annotated bird song sequences" was the most interesting find, along with some interesting datasets (NIPS, Cornell Birdcall).
I was envisioning a ML powered device that could translate bird chirps to human readable text but my guess is that we're still in the fundamental research phase. One idea I had was recording stuff in my garden and running it through some unsupervised algorithms to identify some patterns than match it with video and maybe tag context. Would be really neat to find a pattern and see it correspond to the same situation (cat approaching). Seems like a neat summer project but I'm not even sure how to tag and label things :)
A first version that identifies the individual birds and their species would already be cool and I suppose feasible. Bird A (sparrow) speaking...bird B speaking etc. would already be fun...might give them random names, too instead of A,B,C. That would also help with the next stage for tagging etc.
- tomrod 3y agoI believe ML could certainly perform cataloging (clustering). That would be step one to assigning inherent meaning.
- defrex 3y agoAza Raskin's earth species project is working on this. He gave a ted talk about it recently, in which he also recommends a couple books. https://youtu.be/3tUXbbbMhvk?si=6ESL-zuPIHXFULbC https://youtu.be/3tUXbbbMhvk?si=6ESL-zuPIHXFULbC
- jonah 3y agoI recently saw Nathan Pieplow's talk The Language of Birds. It was a pretty good intro to the kind of things we know about bird communication (a fair amount) and what we don't know (a lot). https://earbirding.com/blog/talks https://earbirding.com/blog/talks Maybe you can find a recording somewhere or further references. The whole concept of birding by ear is pretty cool. We always have the Merlin bird sound AI app at the ready whenever we're hiking.
- TaylorAlexander 3y agoThanks for the tip! It does look like there are several recordings on YouTube. I’ll have to give this a listen. https://youtu.be/IO04p2qM5Y0?si=WY6MzH2c9QGcOHsf https://youtu.be/IO04p2qM5Y0?si=WY6MzH2c9QGcOHsf
- dylan604 3y agothis guy sums it up pretty well: https://www.youtube.com/watch?v=By_rSYI0Ovs https://www.youtube.com/watch?v=By_rSYI0Ovs
- jnellis 3y agoI use the Merlin app which is pretty accurate at identifying birds by sound. Once it hits on a bird it will give you a list of different calls that bird makes regarding what it might be trying to do (aka mating, predator near) so you can match it further but that part is not automated yet.
- temp0826 3y agoI've been living in southern Mexico in the jungle for the last year or so and this app has been a blast. Whenever we hear something new we all whip our our phones and learn something.