3 ms·
See it as a temporary workaround, and assume each instruction will also lead to additional training data to try to achieve the same in the next model directly.
by vidarh 2y ago
See it as a temporary workaround, and assume each instruction will also lead to additional training data to try to achieve the same in the next model directly.
- kikimora 2y agoIt comes down to solving this - given instruction X find out how to change the training data such that X is obeyed and none other side effects appears. Given amount if the training data and complexities of involved in training I don’t think there is a clear way to do it.
- vidarh 2y agoI'm slightly less sceptical that they can do it, but we presumably agree that changing the prompt is far faster, and so you change the prompt first, and the prompt effectively will serve in part as documentation of issues to chip away at while working on the next iterations of the underlying models.