2 ms·
This sounds so amazing! In a way you can use language relationships to identify visual training data. Say someone asks your model to find pictures of a leash.
by mrfusion 6y ago
This sounds so amazing! In a way you can use language relationships to identify visual training data.
Say someone asks your model to find pictures of a leash. If it’s never been trained on leashes it can use the language model to know they’re associated with dogs, attach to the collar, etc and actually find pictures of leashes and start training itself.
The possibilities are endless. Let me know if there is further reading I can do.
- RugnirViking 6y agoI don't know of any well written texts about this for laymen, but if you're up for a slightly tough (not too bad) read, this paper provides a nice introduction to the field from 2018, although a small part of it requires a little understanding of maths and statistics symbols. Grounded Language Learning: Where Robotics and NLP Meet* https://www.ijcai.org/Proceedings/2018/0810.pdf https://www.ijcai.org/Proceedings/2018/0810.pdf