Well, right now we think performance comes from software plus hardware. I think going forward, performance will come from software, hardware and training. Cha

Well, right now we think performance comes from software plus hardware. I think going forward, performance will come from software, hardware and training. Chances are that ChatGPT in the current configuration (i.e. same NN architecture and number of parameters) run on the current hardware would be much more powerful if you could continue training it with 10 times more data than you used so far. Separate from that, I think you could also increase tremendously ChatGPT's power if you could pair it with some regular old-fashioned computer. For example, if you ask ChatGPT to write some python code, it produces code that is surprisingly close to correct. But why not give ChatGPT a separate module or sandbox where it can actually run and test that code?