3 ms·
You're making an unwarranted assumption: that the methods used to predict the next token in human language would work for predicting the next token in a simulat
by tsimionescu 5y ago
You're making an unwarranted assumption: that the methods used to predict the next token in human language would work for predicting the next token in a simulation of SimCity or history or weather etc.
As far as we've seen, each of DeepMind's and OpenAI's successes have been a different network architecture, it's not like we have one network architecture that is good at learning anything you throw at it.
Not to mention, the huge problem with weather and history is the limited amount of data, compared to human language, for which there are immense troves.