2 ms·
I think the main bottleneck right now is training data - they've basically exhausted all public sources of data, so they have to either pay humans to generate n
by rrrrrrrrrrrryan 2y ago
I think the main bottleneck right now is training data - they've basically exhausted all public sources of data, so they have to either pay humans to generate new data from scratch or pay for the reasoning models to generate (less useful) synthetic training data. The next bottleneck is hardware, and the least important bottleneck is money.