3 ms·
Yeah the multimodal work is already making progress and will likely be the future. That problem seems solvable soonish. Sequence of actions is much harder but w
by mountainriver 5y ago
Yeah the multimodal work is already making progress and will likely be the future. That problem seems solvable soonish. Sequence of actions is much harder but with their new Chain of Thought research and whats happened in RL, I wouldn't be surprised if this was mostly solved in < 10 years. Retrieval transformers are the most promising on memory.
- whimsicalism 5y agoI think multimodal work is still very much in the early stages. That said, I don't see any reason why the exact same approach we are using here wouldn't work ultimately for multi-modal settings as well. Memory also seems easy to solve. I am still very skeptical of our current approach in relation to sequences of actions, reasoning, discrete choices, and interaction with complex environments. RL is at baby level compared to the advances we have made in language modeling.