3 ms·
You cannot say that with any certainty. While GPT4 shows great promise it’s still not clear at all that the current architecture can keep scaling up. Presumably
by woeirua 4y ago
You cannot say that with any certainty. While GPT4 shows great promise it’s still not clear at all that the current architecture can keep scaling up. Presumably they’re already using all the data they have access to. So what’s left to improve performance? Changes in architecture, some of which could require significantly different hardware.
- jbenjoseph 4y agoThe massive amount of money going into AI could invariably lead to the development of new and even more successful architectures. Although speculating on what and when would be like perfectly predicting the development of the Transformer architecture while living in 2010 or something.
- JohnFen 4y ago> The massive amount of money going into AI could invariably lead to the development of new and even more successful architectures. Money does not guarantee results, even if the amount of money is massive.