4 ms·
We are entering a period of Moore's law for GPT bots. The claim by NVIDIA that in 10 years a GPT bot will be one million times more powerful than ChatGPT may or
by credit_guy 4y ago
We are entering a period of Moore's law for GPT bots. The claim by NVIDIA that in 10 years a GPT bot will be one million times more powerful than ChatGPT may or may not pan out. But I can easily see a factor of one thousand, which means a doubling of capabilities each year.
Five years from now the world will be unrecognizable.
- icapybara 4y agoI think one big difference might be that we are limited by hardware. For this to be true, the models and algorithms will need to become exponentially more efficient over time, because the hardware won't.
- credit_guy 4y agoWell, right now we think performance comes from software plus hardware. I think going forward, performance will come from software, hardware and training. Chances are that ChatGPT in the current configuration (i.e. same NN architecture and number of parameters) run on the current hardware would be much more powerful if you could continue training it with 10 times more data than you used so far. Separate from that, I think you could also increase tremendously ChatGPT's power if you could pair it with some regular old-fashioned computer. For example, if you ask ChatGPT to write some python code, it produces code that is surprisingly close to correct. But why not give ChatGPT a separate module or sandbox where it can actually run and test that code?