3 ms·
Definitely disappointed to see how paternalistic the open model is, was hoping it'd be more free-flowing and less corporate. However, all of the data is open,
by Taek 4y ago
Definitely disappointed to see how paternalistic the open model is, was hoping it'd be more free-flowing and less corporate.
However, all of the data is open, and you can actually prompt these models to revise the training data to remove the caution and safety, then run the fine-tuning yourself to produce a model that isn't so up-tight.
- Vuizur 4y agoI could replicate the refusal, but all it took to get the model to reply properly was replacing "evil hacker" with "hacker". Paternalism is not that big of a deal right now, especially when compared to ChatGPT/Bing Chat. The fine tuning data doesn't contain a lot (any?) task refusal.
- consumer451 4y agoOh wow, derp on my part.