3 ms·
It comes down to solving this - given instruction X find out how to change the training data such that X is obeyed and none other side effects appears. Given am
by kikimora 1y ago
It comes down to solving this - given instruction X find out how to change the training data such that X is obeyed and none other side effects appears. Given amount if the training data and complexities of involved in training I don’t think there is a clear way to do it.
- vidarh 1y agoI'm slightly less sceptical that they can do it, but we presumably agree that changing the prompt is far faster, and so you change the prompt first, and the prompt effectively will serve in part as documentation of issues to chip away at while working on the next iterations of the underlying models.