> Fast forward ten years My laundry list for GPT-4 is: - multi-modal - image + text + other modalities - multi-task - the training data should include all us

> Fast forward ten years My laundry list for GPT-4 is: - multi-modal - image + text + other modalities - multi-task - the training data should include all useful supervised datasets and knowledge bases besides next token prediction - longer context window - using external search and an external memory bank - so it is up to date without retraining, and has episodic memory This kind of general model could be hooked up to a virtual body and trained on a diverse set of RL tasks, the problem is that it's probably too slow for real time use.