3 ms·
I've also been wondering this. Can we train an LLM on dolphin noises? I suspect the problem is the training data. If we don't know what the dolphin squeaks mea
by chatmasta 4y ago
I've also been wondering this. Can we train an LLM on dolphin noises?
I suspect the problem is the training data. If we don't know what the dolphin squeaks mean, we can't really filter the training data to include only meaningful "language." But I do wonder how far we could get by just dumping a bunch of dolphin recordings into an LLM and getting it to make the same noises...
The other side of that same problem is that we would have no way of knowing whether it's working. Even if it could "communicate" perfectly, we would have no way of understanding it, aside from watching real dolphins interact with it. But maybe we could build an artificial dolphin, load an LLM into it, and drop it in a pool with real dolphins... just to see what happens...
- holoduke 4y agoYou can use it to identify patterns and other interesting aspects. First steps in understanding a language without any reference.
- tonymillion 4y agoI feel the only recognisable words we’d decode is a farewell and some kind of gratitude about food…
- smegger001 4y agopossible also greeting, demand for food, and telling us to piss off.
- amanaplanacanal 4y agoAnd probably hitting on us. Dolphins are horny creatures.
- nico 4y agoThey say the brain is the OG sex organ. And dolphins have waay bigger brains than humans… adds up.
- JoBrad 4y agoThanks for all the fish!
- PeterisP 4y agoThey key issue with lack of training data is that we do have intelligent dolphins for communication experiments - for example, we can replay certain sounds that we have recorded, and we can "ground" that language with "nonverbal" communication - e.g. showing various things or pictures.
- ftxbro 4y agoYes that's the point of project CETI https://www.projectceti.org/ https://www.projectceti.org/ but for sperm whales instead of dolphins. I saw a video of it, it was so amazing but I forget which one of the videos it was.
- XorNot 4y agoOne issue with this is that dolphins don't have a consistent "language". There are at the very least different dialects in different parts of the ocean. So one issue is ensuring your model is using sounds from a group of dolphins speaking the same "language" - otherwise you're at risk of trying to "translate human" by feeding a mix of English and Chinese.
- rqtwteye 4y agoIt would be cool to develop robots that can follow a group of whales for a long time and observe and record. That should give us real training data.