7 ms·
Researchers are still picking low hanging fruit by the fortnight. We are a lo00000ng way from a place where we may even estimate the peak capability. Look at w
by flangola7 3y ago
Researchers are still picking low hanging fruit by the fortnight. We are a lo00000ng way from a place where we may even estimate the peak capability.
Look at what GPT-4 can achieve from only receiving text and a primitive form of image training.
- croes 3y agoBut models like GPT-4 depend on good quality training data, and that resource is limited, means maybe we aren't so long away from peak at least for LLMs. There is no unlimited growth, and after the low hanging fruits each step in progress will be exponentially harder.
- gmerc 3y agoWhile true, we’ve been successfully keeping up this illusion for the whole economy for many decades.
- flangola7 3y ago> But models like GPT-4 depend on good quality training data, and that resource is limited Most data has not been incorporated into a model yet. Most data is not in text format. We don't know what is possible once that changes.