4 ms·
Yeah, with the catch being that junior devs then become senior devs to review the code as the accumulate feedback given by the reward function.
by Muromec 2y ago
Yeah, with the catch being that junior devs then become senior devs to review the code as the accumulate feedback given by the reward function.
- ithkuil 2y agoWhich is something that in principle AI tools could do, i.e. learn from feedback is how they got created in the first place. However the current generation of models needs a specific form of training set that is quite different from what a human would produce through direct interaction with the model. For one it needs many more examples than a human would need. But also the form of the example is different: it must be an example of an acceptable answer. This way a model can compute how far it is from the desired outcome. Further research in how to efficiently fine tune models will make this gap narrower and perhaps senior devs will be able to efficiently give learnable feedback through their normal course of interaction