3 ms·
Sure, but it's still a statistical model, it doesn't know what the instructions mean, it just does what those instructions statistically link to in the training
by AnarchismIsCool 3y ago
Sure, but it's still a statistical model, it doesn't know what the instructions mean, it just does what those instructions statistically link to in the training data. It's not doing perfect forward logic and never will in this paradigm.
- astrange 3y agoThe fine tuning process isn't itself a statistical model, so that principle doesn't work on it. You beat the model into shape until it does what you want (DPO and varieties of that) and you can test that it's doing that.
- AnarchismIsCool 3y agoYeah but you're still beating up a statistical model that's gonna do statistical things. Also we're talking about prompt engineering more than fine-tune