5 ms·
Sadly OpenAI used to do this, by making log probabilities available. But they have been removed from the API.
by smeagull 3y ago
Sadly OpenAI used to do this, by making log probabilities available. But they have been removed from the API.
- nullc 3y agoused to be really useful for detecting text written with the same model, as it was high probability... unfortunately the probabilities are messed up by RLHF.
- tshadley 3y agoAh, that's it; polite fictions are scored higher than uncomfortable facts.
- tshadley 3y agoThat's weird. Having the community study this would certainly help them. They're afraid this is giving too much insight into their proprietary training/modeling methods?