3 ms·
But models like GPT-4 depend on good quality training data, and that resource is limited, means maybe we aren't so long away from peak at least for LLMs. There
by croes 3y ago
But models like GPT-4 depend on good quality training data, and that resource is limited, means maybe we aren't so long away from peak at least for LLMs.
There is no unlimited growth, and after the low hanging fruits each step in progress will be exponentially harder.
- gmerc 3y agoWhile true, we’ve been successfully keeping up this illusion for the whole economy for many decades.
- flangola7 3y ago> But models like GPT-4 depend on good quality training data, and that resource is limited Most data has not been incorporated into a model yet. Most data is not in text format. We don't know what is possible once that changes.