4 ms·
I think that’s mostly because they get so much more of that reinforcement learning - since it is so economical. I dont know if there is any evidence of a fundam
by jeremyjh 5mo ago
I think that’s mostly because they get so much more of that reinforcement learning - since it is so economical. I dont know if there is any evidence of a fundamental reason they can’t be just as good at other tasks, but it might be economically infeasible for awhile yet.
- mjburgess 5mo agoNo one is curating vast amounts of data for them in other domains. Programmers send programs with fixes
- knollimar 5mo agoThere's no diff of my excel lambdas being fixed? :(
- jeremyjh 5mo agoIts more about how costly it is to verify work in reinforcement learning. It is cheap in Mathematics and coding because it can be automated. It is expensive in other domains because while you can capture certain datasets to do pre-training on, you ultimately need humans in the loop to judge the quality of work.
- emp17344 5mo agoRLVR doesn’t work for unverifiable tasks, so they won’t be able to effectively use tools to boost reliability for those tasks.
- jeremyjh 5mo agoRight, so you have to use RLHF. That is the economics problem I was referring to.