4 ms·
The AI revolution is running out of data
- kelseyfrog 2y agoYes and no. I personally feel like multi-modality and embodiment is the next step and has both incredible challenges as well as opportunities. The limitation for embodiment data is two-fold. Synthetic embodiment is distributionally limited. Physical embodiment is hardware limited. Either way, it's an interesting space to be in and I wouldn't be surprised if embodiment training has positive spillover effects in language comprehension along with improvements in other domains.
- ai-christianson 2y agoBy synthetic embodiment, do you mean placing the agent into a simulated physical environment? E.g. something like mindcraft (https://github.com/kolbytn/mindcraft https://github.com/kolbytn/mindcraft).
- kelseyfrog 2y agoYes. Waabi World[1] would be another. 1. https://waabi.ai/waabi-world/ https://waabi.ai/waabi-world/
- tyronehed 2y ago[dead]
- aurareturn 2y agoThere is nearly an unlimited amount of data. For example, feed real world video/sensory data into LLMs and they can learn how real world physical objects behave. Simulate physics with a physics engine and then feed that data into the LLM. The internet represented easy/low hanging fruit data. It doesn't seem like the transformer algorithm is limited to pure text training data.
- bobosha 2y agoMining visual data—whether from CCTV, smartphone videos, or other sources—is the next big frontier. Given its immense information density, the potential payoffs could far exceed those of previous data revolutions.