2 ms·
Yes and no. I personally feel like multi-modality and embodiment is the next step and has both incredible challenges as well as opportunities. The limitation fo
by kelseyfrog 2y ago
Yes and no. I personally feel like multi-modality and embodiment is the next step and has both incredible challenges as well as opportunities. The limitation for embodiment data is two-fold. Synthetic embodiment is distributionally limited. Physical embodiment is hardware limited. Either way, it's an interesting space to be in and I wouldn't be surprised if embodiment training has positive spillover effects in language comprehension along with improvements in other domains.
- ai-christianson 2y agoBy synthetic embodiment, do you mean placing the agent into a simulated physical environment? E.g. something like mindcraft (https://github.com/kolbytn/mindcraft https://github.com/kolbytn/mindcraft).
- kelseyfrog 2y agoYes. Waabi World[1] would be another. 1. https://waabi.ai/waabi-world/ https://waabi.ai/waabi-world/