3 ms·
1. You train a model to exhibit a certain behavior 2. You use it to make synthetic data, data that's completely unrelated to that behavior, and then fine tune
by ACCount36 1y ago
1. You train a model to exhibit a certain behavior
2. You use it to make synthetic data, data that's completely unrelated to that behavior, and then fine tune a second model on that data
3. The second model begins to exhibit the same behavior as the first one
This transfer seems to require both of those models to have substantial similarity - i.e. to be based on the same exact base model.
- mark4 1y agoThank you!