4 ms·
Evals Are the Next Bottleneck
- sks 1mo agoEvals saturating faster is interesting. Do you think this is an indication of RL or training pipelines getting better over time at the labs, or is this primarily an indication of the data / RL-environment industry scaling up over time?
- ssatia 1mo agoLikely both. Labs are getting faster at identifying capability gaps and building or commissioning work that can help develop those capabilities. Similarly the data industry is also getting more efficient with requests with faster turnaround times and better yields.
- chw1572 1mo ago[flagged]
- ravipunia59 1mo ago[dead]
- deepikadevi 1mo ago[dead]
- rfardanir 1mo ago[dead]